00000001:02000400:3.0F:1788620034.656553:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788620050.623440:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788620052.381639:0:3248:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 651 MB/s 00000001:01000000:0.0F:1788620052.631465:0:3248:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 483 MB/s 00000001:01000000:2.0F:1788620052.883419:0:3248:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3075 MB/s 00000020:02000000:3.0:1788620053.576761:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_85_gb449de9 00000400:02000000:3.0:1788620054.441754:0:3292:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.111@tcp [8/256/0/180] 00008000:02000000:3.0:1788620058.307222:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788620102.297830:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788620112.027734:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788620112.027739:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788620112.030947:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000eb7fef38 00000080:02000400:3.0:1788620112.030966:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788620112.042018:0:5820:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788620112.042035:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788620112.042079:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a188931d) 00000020:00000080:3.0:1788620112.042099:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788620112.073661:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788620112.077497:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788620112.123106:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788620112.123148:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788620112.123169:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788620112.123219:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788620112.123244:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788620112.123987:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788620112.123996:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788620112.124008:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd0172 00000020:01000004:3.0:1788620112.124016:0:5820:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788620112.124021:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788620112.124025:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eb7fef38 from MGS 00000020:01000004:3.0:1788620112.124030:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788620112.124041:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000cc3596aa) 00000020:00000080:3.0:1788620112.124050:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788620112.124112:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb7fef38 from MGS, refs=2 00080000:01000000:3.0:1788620112.124117:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788620112.124122:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd0180 00000100:00100000:3.0:1788620112.124215:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788620112.124555:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788620112.124561:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788620112.125184:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788620112.125191:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788620112.126095:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620112.126531:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788620112.126546:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788620112.127056:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788620112.127063:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788620112.127647:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788620112.127653:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788620112.128193:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620112.128196:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620112.128198:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620112.128638:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620112.128641:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620112.128643:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620112.129235:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788620112.133003:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788620112.379444:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2960 MB/s 00000001:01000000:2.0:1788620112.629728:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2983 MB/s 00000001:01000000:0.0:1788620112.879937:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 507 MB/s 00000001:01000000:2.0:1788620113.131127:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 581 MB/s 00080000:10000000:3.0:1788620113.154624:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788620113.184045:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788620113.184074:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788620113.184076:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788620113.191168:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00010000:00010000:3.0:1788620113.196081:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788620113.198983:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788620113.199051:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788620113.199623:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788620113.199652:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788620113.200138:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620113.200504:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788620113.200511:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788620113.202928:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788620113.202943:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788620113.203541:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788620113.203550:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788620113.205681:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788620113.205709:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.111@tcp' 00000020:01000004:1.0:1788620113.205711:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788620113.205768:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.111@tcp (typ=mgc) 00000020:00000080:1.0:1788620113.205790:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.111@tcp (00000000cf1caeb2) 00000020:00000080:1.0:1788620113.205807:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788620113.206141:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cbce50f4@MGC192.168.201.111@tcp: add connection 192.168.201.111@tcp at head 00010000:00010000:1.0:1788620113.206334:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.111@tcp-0 is initialized 00000040:01000000:1.0:1788620113.206341:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788620113.207192:0:5835:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788620113.211190:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788620113.213982:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.111@tcp (uuid 4e39889e-8996-4811-9fe8-f1c6c0211740) 00000020:00000080:0.0:1788620113.214013:0:5820:0:(genops.c:1385:class_connect()) connect: client 4e39889e-8996-4811-9fe8-f1c6c0211740, cookie 0x24857de440bd018e 00000100:00080000:0.0:1788620113.214026:0:5820:0:(import.c:510:import_select_connection()) MGC192.168.201.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620113.214031:0:5820:0:(import.c:624:import_select_connection()) MGC192.168.201.111@tcp: import 00000000cbce50f4 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:0.0:1788620113.214081:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001199f9b6 x1875504061743232/t0(0) o250->MGC192.168.201.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788620113.214109:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4e39889e-8996-4811-9fe8-f1c6c0211740->MGS 00000020:01000004:0.0:1788620113.214129:0:5820:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788620113.214134:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788620113.214154:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003f1eebd2) 00000020:00000080:0.0:1788620113.214168:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788620113.216790:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001199f9b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e39889e-8996-4811-9fe8-f1c6c0211740:3307:1875504061743232:0@lo:250: 00000100:00100000:2.0:1788620113.216958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620113.220625:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061743232 00000100:00100000:2.0:1788620113.220639:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061743232 00000100:00100000:2.0:1788620113.220688:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620113.220694:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098e6a6d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875504061743232:12345-0@lo:250: 00010000:00080000:2.0:1788620113.220719:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4e39889e-8996-4811-9fe8-f1c6c0211740@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:2.0:1788620113.220745:0:5832:0:(genops.c:1385:class_connect()) connect: client 4e39889e-8996-4811-9fe8-f1c6c0211740, cookie 0x24857de440bd019c 00000100:00080000:2.0:1788620113.220882:0:5832:0:(import.c:65:import_set_state_nolock()) 0000000031e89aee : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620113.220946:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098e6a6d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+5:3307:x1875504061743232:12345-0@lo:250: Request processed in 252us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620113.220951:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620113.220996:0:3307:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788620113.221004:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1788620113.221009:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788620113.221013:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788620113.221015:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000cbce50f4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788620113.221017:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788620113.221026:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788620113.221031:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001199f9b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e39889e-8996-4811-9fe8-f1c6c0211740:3307:1875504061743232:0@lo:250: 00000100:00100000:0.0:1788620113.237216:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620113.240181:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788620113.240198:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788620113.250161:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788620113.250202:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788620113.251080:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788620113.251089:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788620113.255653:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620113.256504:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788620113.256513:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788620113.257741:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788620113.257759:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788620113.320671:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620113.320998:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788620113.321005:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788620113.323470:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788620113.323487:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788620113.324222:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620113.324458:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788620113.324463:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788620113.325093:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788620113.325101:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788620113.325760:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620113.325999:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788620113.326004:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788620113.326554:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788620113.326569:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788620113.327555:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620113.327770:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788620113.327775:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788620113.337622:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788620113.337652:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788620113.389706:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620113.390457:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788620113.390465:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788620113.395926:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788620113.395941:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788620113.397797:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788620113.397813:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788620113.398749:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788620113.398777:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788620113.398783:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788620113.398942:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788620113.398975:0:5820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.111@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788620113.398980:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788620113.398981:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620113.398987:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620113.398988:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620113.398989:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620113.398990:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620113.398991:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620113.398992:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620113.398993:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788620113.398995:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788620113.398996:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620113.398997:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788620113.398999:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788620113.399001:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788620113.399002:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620113.399003:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620113.399004:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620113.399005:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620113.399006:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620113.399007:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620113.399007:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620113.399008:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788620113.399009:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788620113.399010:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620113.399011:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788620113.399046:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788620113.399064:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d75d326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743360:0@lo:253: 00000100:00100000:1.0:1788620113.399140:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620113.399304:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061743360 00000100:00100000:0.0:1788620113.399312:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061743360 00000100:00100000:0.0:1788620113.399345:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620113.399353:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058509361 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+5:5820:x1875504061743360:12345-0@lo:253: 20000000:01000000:0.0:1788620113.399407:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788620113.399410:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:1.0:1788620113.399948:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e4ba549 going to sleep for 11 seconds 10000000:01000000:0.0:1788620113.400116:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788620113.400164:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788620113.400440:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620113.408294:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788620113.408544:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788620113.408549:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788620113.408555:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788620113.408558:0:5834:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788620113.408573:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788620113.408840:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620113.409062:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788620113.409076:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788620113.409124:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788620113.409167:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788620113.409203:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788620113.409308:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788620113.409315:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788620113.409353:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788620113.409361:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788620113.409393:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788620113.409406:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788620113.409438:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788620113.409466:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788620113.409485:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788620113.409489:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788620113.409496:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620113.409642:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788620113.409652:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788620113.409685:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788620113.409719:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788620113.409751:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788620113.409758:0:5834:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788620113.409799:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788620113.409804:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788620113.409854:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788620113.409891:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788620113.409921:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788620113.409933:0:5834:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788620113.410012:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788620113.410021:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788620113.410052:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788620113.410085:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788620113.410228:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788620113.410286:0:5834:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788620113.410291:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788620113.415319:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788620113.415845:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788620113.415873:0:5834:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.111@tcp for mdt 20000000:01000000:0.0:1788620113.415876:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788620113.415903:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788620113.415908:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788620113.415923:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788620113.415927:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.111@tcp (null) (null) 00000040:00080000:0.0:1788620113.415952:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788620113.415958:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788620113.415988:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788620113.416020:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788620113.416063:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788620113.416066:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788620113.416070:0:5834:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788620113.416076:0:5834:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788620113.416490:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788620113.416565:0:5834:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788620113.427399:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788620113.427457:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788620113.427523:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788620113.427541:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788620113.427557:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788620113.427561:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788620113.427572:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788620113.427575:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788620113.427672:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788620113.427674:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788620113.428565:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788620113.428920:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788620113.428978:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788620113.429044:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1788620113.429057:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788620113.429059:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788620113.429864:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788620113.430202:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788620113.430244:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788620113.430404:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788620113.430414:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788620113.430421:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788620113.430427:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788620113.430443:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430457:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430463:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430467:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430471:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430474:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430478:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000004939215 already unused, calling callback (000000003ecde37c) 00010000:00010000:0.0:1788620113.430480:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430484:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430492:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430496:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620113.430505:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004939215/0x24857de440bd01a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788620113.430517:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788620113.694004:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058509361 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+5:5820:x1875504061743360:12345-0@lo:253: Request processed in 294644us (294857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620113.694029:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620113.694137:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d75d326 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743360:0@lo:253: 10000000:01000000:3.0:1788620113.694154:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788620113.694158:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788620113.694160:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788620113.694161:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620113.694163:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788620113.694164:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620113.694165:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620113.694167:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788620113.694168:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788620113.694169:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788620113.694170:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620113.694172:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788620113.694189:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eb7fef38 from lustre-MDT0000 10000000:01000000:3.0:1788620113.694213:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788620113.694215:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788620113.694219:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0d664da4d28 10000000:01000000:3.0:1788620113.694224:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788620113.694231:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0d664da4d28 from 1 10000000:01000000:3.0:1788620113.694234:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788620113.694307:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 000000003fa094e1/0x24857de440bd01aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.694318:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 000000003fa094e1/0x24857de440bd01aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.694326:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 000000003fa094e1/0x24857de440bd01aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620113.694350:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b13095c pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743488:0@lo:101: 00000100:00100000:3.0:1788620113.694385:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620113.694443:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f4c9349 going to sleep for 11 seconds 00000100:00100000:2.0:1788620113.694527:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061743488 00000100:00100000:2.0:1788620113.694534:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061743488 00000100:00100000:2.0:1788620113.694580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620113.694589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f12bf865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+5:5820:x1875504061743488:12345-0@lo:101: 00010000:00010000:2.0:1788620113.694613:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620113.694633:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad1dc175/0x24857de440bd01b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd01aa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620113.694656:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad1dc175/0x24857de440bd01b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd01aa expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620113.694665:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad1dc175/0x24857de440bd01b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd01aa expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620113.694673:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad1dc175, rc 0) 00000100:00100000:2.0:1788620113.694754:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f12bf865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+6:5820:x1875504061743488:12345-0@lo:101: Request processed in 166us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620113.694760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620113.694925:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b13095c pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743488:0@lo:101: 00010000:00010000:1.0:1788620113.694939:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 000000003fa094e1/0x24857de440bd01aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.694947:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 000000003fa094e1/0x24857de440bd01aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620113.695017:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743616:0@lo:501: 00000100:00100000:1.0:1788620113.695044:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620113.695069:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6eb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788620113.695121:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061743616 00000100:00100000:2.0:1788620113.695125:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061743616 00000100:00100000:2.0:1788620113.695154:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620113.695160:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007615fd53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+6:5820:x1875504061743616:12345-0@lo:501: 00000100:00100000:2.0:1788620113.695397:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007615fd53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+6:5820:x1875504061743616:12345-0@lo:501: Request processed in 237us (352us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788620113.695404:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620113.695516:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743616:0@lo:501: 10000000:01000000:1.0:1788620113.695541:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788620113.695556:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: 000000003fa094e1/0x24857de440bd01aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.695563:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: 000000003fa094e1/0x24857de440bd01aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620113.695570:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0d649f43000 10000000:01000000:1.0:1788620113.695574:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788620113.695578:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0d649f43000 10000000:01000000:1.0:1788620113.695580:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788620113.695583:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0d649f43000 from 1 10000000:01000000:1.0:1788620113.695586:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788620113.695613:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 00000000dee8f643/0x24857de440bd01b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.695620:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 00000000dee8f643/0x24857de440bd01b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.695628:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 00000000dee8f643/0x24857de440bd01b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620113.695639:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743744:0@lo:101: 00000100:00100000:1.0:1788620113.695673:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620113.695700:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6eb7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620113.695804:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061743744 00000100:00100000:3.0:1788620113.695818:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061743744 00000100:00100000:3.0:1788620113.695848:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620113.695854:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a48d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+6:5820:x1875504061743744:12345-0@lo:101: 00010000:00010000:3.0:1788620113.695861:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620113.695871:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c327ab7/0x24857de440bd01bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd01b8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.695884:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c327ab7/0x24857de440bd01bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd01b8 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.695891:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c327ab7/0x24857de440bd01bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd01b8 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.695898:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c327ab7, rc 0) 00000100:00100000:3.0:1788620113.695927:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a48d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+7:5820:x1875504061743744:12345-0@lo:101: Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620113.695932:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620113.696008:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743744:0@lo:101: 00010000:00010000:1.0:1788620113.696017:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 00000000dee8f643/0x24857de440bd01b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.696024:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 00000000dee8f643/0x24857de440bd01b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620113.696033:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788620113.696036:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: 00000000dee8f643/0x24857de440bd01b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.696042:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: 00000000dee8f643/0x24857de440bd01b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620113.696048:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788620113.696051:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788620113.696055:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0d649f43000 10000000:01000000:1.0:1788620113.696057:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788620113.696060:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788620113.696062:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788620113.696074:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 0000000093c73f41/0x24857de440bd01c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.696080:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 0000000093c73f41/0x24857de440bd01c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.696086:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 0000000093c73f41/0x24857de440bd01c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620113.696102:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743872:0@lo:101: 00000100:00100000:1.0:1788620113.696126:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620113.696229:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6eb7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620113.696379:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061743872 00000100:00100000:3.0:1788620113.696384:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061743872 00000100:00100000:3.0:1788620113.696449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620113.696456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c070393e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+7:5820:x1875504061743872:12345-0@lo:101: 00010000:00010000:3.0:1788620113.696463:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620113.696471:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004cf3bc1/0x24857de440bd01cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd01c6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.696489:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004cf3bc1/0x24857de440bd01cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd01c6 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.696497:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004cf3bc1/0x24857de440bd01cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd01c6 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620113.696504:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004cf3bc1, rc 0) 00000100:00100000:3.0:1788620113.696541:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c070393e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+8:5820:x1875504061743872:12345-0@lo:101: Request processed in 86us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620113.696547:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620113.696613:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061743872:0@lo:101: 00010000:00010000:1.0:1788620113.696622:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 0000000093c73f41/0x24857de440bd01c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620113.696629:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 0000000093c73f41/0x24857de440bd01c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620113.696666:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744000:0@lo:501: 00000100:00100000:1.0:1788620113.696690:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620113.696834:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6eb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788620113.696903:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744000 00000100:00100000:2.0:1788620113.696908:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744000 00000100:00100000:2.0:1788620113.696927:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620113.696932:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a9c15f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+8:5820:x1875504061744000:12345-0@lo:501: 00000100:00100000:2.0:1788620113.697133:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a9c15f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5820:x1875504061744000:12345-0@lo:501: Request processed in 201us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620113.697140:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620113.697217:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744000:0@lo:501: 00000100:00100000:1.0:1788620113.697244:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744128:0@lo:503: 00000100:00100000:1.0:1788620113.697298:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620113.697319:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6eb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788620113.697372:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744128 00000100:00100000:2.0:1788620113.697376:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744128 00000100:00100000:2.0:1788620113.697399:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788620113.697403:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071bf5ed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5820:x1875504061744128:12345-0@lo:503: 00000100:00100000:2.0:1788620113.697558:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071bf5ed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5820:x1875504061744128:12345-0@lo:503: Request processed in 153us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620113.697565:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788620113.697692:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744128:0@lo:503: 00000100:00100000:1.0:1788620113.698035:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5862:1875504061744256:0@lo:502: 00000100:00100000:1.0:1788620113.698073:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620113.698102:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000add26dc8 going to sleep for 11 seconds 00000100:00100000:2.0:1788620113.698152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744256 00000100:00100000:2.0:1788620113.698157:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744256 00000100:00100000:2.0:1788620113.698175:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788620113.698180:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd47307e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5862:x1875504061744256:12345-0@lo:502: 00000100:00100000:2.0:1788620113.698344:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd47307e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5862:x1875504061744256:12345-0@lo:502: Request processed in 163us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620113.698350:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620113.698433:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5862:1875504061744256:0@lo:502: 00000020:01000000:1.0:1788620113.698456:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620113.698468:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620113.698475:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788620113.698480:0:5862:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788620113.698483:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788620113.698496:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000eb5f75e0) 00000020:00000080:1.0:1788620113.698513:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788620113.698519:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788620113.699291:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788620113.699302:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd01db 00000020:00000080:1.0:1788620113.699551:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788620113.699557:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620113.699562:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620113.699564:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788620113.699566:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620113.699570:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620113.699571:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788620113.699574:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788620113.699582:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000021aa33ad) 00000020:00000080:1.0:1788620113.699592:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788620113.699596:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788620113.699597:0:5862:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788620113.699600:0:5862:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788620113.699605:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788620113.699664:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb7fef38 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788620113.699677:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000bca85dad) 00000020:00000080:1.0:1788620113.699684:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788620113.699734:0:5862:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788620113.699740:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd01f0 00000020:00000080:1.0:1788620113.699840:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788620113.699847:0:5862:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788620113.699851:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x24857de440bd01f7 00080000:01000000:1.0:1788620113.699855:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788620113.699858:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd01fe 00080000:10000000:1.0:1788620113.700295:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788620113.700487:0:5862:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788620113.705695:0:5862:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788620113.825806:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788620113.826188:0:5862:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788620113.829057:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788620113.829484:0:5862:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788620113.912003:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006f58030d) 00000020:00000080:2.0:1788620113.912033:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788620113.912112:0:5862:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788620113.912119:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd020c 00000020:00000080:3.0:1788620113.915200:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788620113.923412:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620114.006156:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620114.048215:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620114.078784:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620114.117898:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620114.171116:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788620114.204544:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x24857de440bd0213 00000020:00000080:1.0:1788620114.205225:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788620114.205238:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620114.205245:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620114.205247:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788620114.205396:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620114.205460:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620114.205463:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788620114.205469:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788620114.205515:0:5862:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788620114.205536:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620114.205539:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620114.205540:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788620114.205543:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620114.205546:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620114.205547:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788620114.205550:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788620114.205551:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788620114.205669:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015b8a5b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5862:1875504061744384:0@lo:502: 00000100:00100000:3.0:1788620114.206069:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620114.206192:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 000000007147b47e going to sleep for 11 seconds 00000100:00100000:0.0:1788620114.206422:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744384 00000100:00100000:0.0:1788620114.206431:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744384 00000100:00100000:0.0:1788620114.206515:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620114.206523:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fda6c970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5862:x1875504061744384:12345-0@lo:502: 00000100:00100000:0.0:1788620114.207059:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fda6c970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5862:x1875504061744384:12345-0@lo:502: Request processed in 536us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620114.207067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788620114.207167:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015b8a5b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5862:1875504061744384:0@lo:502: 00000020:01000000:2.0:1788620114.207197:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620114.207203:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620114.207205:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788620114.207209:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788620114.207362:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788620114.207380:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788620114.207393:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: 0000000093c73f41/0x24857de440bd01c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620114.207403:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: 0000000093c73f41/0x24857de440bd01c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620114.207411:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d649f43000 from 1 10000000:01000000:2.0:1788620114.207414:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788620114.207451:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620114.207459:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620114.207467:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620114.207482:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004feca121 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744512:0@lo:101: 00000100:00100000:2.0:1788620114.207513:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620114.207975:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000088f7c336 going to sleep for 11 seconds 00000100:00100000:3.0:1788620114.208102:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744512 00000100:00100000:3.0:1788620114.208109:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744512 00000100:00100000:3.0:1788620114.208139:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620114.208147:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000131ae800 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+9:5820:x1875504061744512:12345-0@lo:101: 00010000:00010000:3.0:1788620114.208160:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620114.208175:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd021a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.208198:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd021a expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.208208:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd021a expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.208216:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f4cf671, rc 0) 00000100:00100000:3.0:1788620114.208275:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000131ae800 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+10:5820:x1875504061744512:12345-0@lo:101: Request processed in 128us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620114.208281:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788620114.208437:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004feca121 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744512:0@lo:101: 00010000:00010000:2.0:1788620114.208449:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620114.208457:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620114.209379:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744640:0@lo:256: 00000100:00100000:3.0:1788620114.209431:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620114.209462:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000006840c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620114.209599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744640 00000100:00100000:2.0:1788620114.209612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744640 00000100:00100000:2.0:1788620114.209643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620114.209651:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006068fb88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+10:5820:x1875504061744640:12345-0@lo:256: 20000000:01000000:2.0:1788620114.209669:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788620114.209675:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788620114.209757:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006068fb88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+10:5820:x1875504061744640:12345-0@lo:256: Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620114.209765:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788620114.209909:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744640:0@lo:256: 10000000:01000000:3.0:1788620114.210710:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788620114.210729:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.210739:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620114.210758:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d649f43000 from 1 10000000:01000000:3.0:1788620114.210760:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620114.210785:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.210792:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.210812:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620114.210827:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744768:0@lo:101: 00000100:00100000:3.0:1788620114.210865:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620114.210892:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000006840c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620114.210994:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744768 00000100:00100000:0.0:1788620114.211001:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744768 00000100:00100000:0.0:1788620114.211033:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788620114.211041:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c7c887 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+10:5820:x1875504061744768:12345-0@lo:101: 00010000:00010000:0.0:1788620114.211050:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620114.211062:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0228 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.211081:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0228 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.211090:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0228 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.211098:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004939215, rc 0) 00000100:00100000:0.0:1788620114.211152:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c7c887 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5820:x1875504061744768:12345-0@lo:101: Request processed in 112us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620114.211164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620114.211773:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744768:0@lo:101: 00010000:00010000:3.0:1788620114.211787:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.211795:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620114.211861:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744896:0@lo:501: 00000100:00100000:3.0:1788620114.211892:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620114.211911:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000006840c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620114.212032:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061744896 00000100:00100000:0.0:1788620114.212037:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061744896 00000100:00100000:0.0:1788620114.212071:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788620114.212079:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df8bf86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5820:x1875504061744896:12345-0@lo:501: 00000100:00100000:0.0:1788620114.212919:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df8bf86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5820:x1875504061744896:12345-0@lo:501: Request processed in 839us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620114.212929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620114.213058:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061744896:0@lo:501: 00000100:00100000:3.0:1788620114.213109:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745024:0@lo:503: 00000100:00100000:3.0:1788620114.213156:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620114.213168:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000006840c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620114.213210:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745024 00000100:00100000:0.0:1788620114.213215:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745024 00000100:00100000:0.0:1788620114.213238:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788620114.213245:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d644ce5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5820:x1875504061745024:12345-0@lo:503: 00000040:00080000:0.0:1788620114.213413:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788620114.213494:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d644ce5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5820:x1875504061745024:12345-0@lo:503: Request processed in 250us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620114.213501:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788620114.214232:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745024:0@lo:503: 00010000:00010000:1.0:1788620114.217788:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788620114.218759:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788620114.219024:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788620114.219046:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620114.219111:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620114.219123:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620114.219170:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788620114.219173:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0d649f43000 10000000:01000000:2.0:1788620114.219176:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0d649f43000 10000000:01000000:2.0:1788620114.219180:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788620114.219186:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d649f43000 from 1 10000000:01000000:2.0:1788620114.219189:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788620114.219223:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 00000000279e3583/0x24857de440bd0236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620114.219231:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 00000000279e3583/0x24857de440bd0236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620114.219242:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 00000000279e3583/0x24857de440bd0236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620114.219323:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004feca121 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745152:0@lo:101: 00000100:00100000:2.0:1788620114.219409:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620114.219455:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000008340b15a going to sleep for 11 seconds 00000100:00100000:0.0:1788620114.219843:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745152 00000100:00100000:0.0:1788620114.219854:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745152 00000100:00100000:0.0:1788620114.219910:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788620114.219919:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026634fff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5820:x1875504061745152:12345-0@lo:101: 00010000:00010000:0.0:1788620114.219934:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620114.219946:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004afb0d53/0x24857de440bd023d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0236 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.220047:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004afb0d53/0x24857de440bd023d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0236 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.220058:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004afb0d53/0x24857de440bd023d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0236 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.220074:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004afb0d53, rc 0) 00000100:00100000:0.0:1788620114.220129:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026634fff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5820:x1875504061745152:12345-0@lo:101: Request processed in 211us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620114.220135:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788620114.220212:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004feca121 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745152:0@lo:101: 00010000:00010000:3.0:1788620114.220225:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 00000000279e3583/0x24857de440bd0236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.220233:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 00000000279e3583/0x24857de440bd0236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620114.220315:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745280:0@lo:501: 00000100:00100000:3.0:1788620114.220354:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620114.220372:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d58ec09c going to sleep for 11 seconds 00000100:00100000:0.0:1788620114.220468:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745280 00000100:00100000:0.0:1788620114.220473:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745280 00000100:00100000:0.0:1788620114.220505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788620114.220512:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fe8e68a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5820:x1875504061745280:12345-0@lo:501: 00000100:00100000:0.0:1788620114.220823:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fe8e68a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5820:x1875504061745280:12345-0@lo:501: Request processed in 311us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620114.220830:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788620114.220935:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745280:0@lo:501: 00000100:00100000:3.0:1788620114.221034:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745408:0@lo:503: 00000100:00100000:3.0:1788620114.221069:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620114.221096:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d58ec09c going to sleep for 11 seconds 00000100:00100000:3.0:1788620114.221109:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745408 00000100:00100000:3.0:1788620114.221112:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745408 00000100:00100000:3.0:1788620114.221139:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788620114.221145:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001130fe61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5820:x1875504061745408:12345-0@lo:503: 00000100:00100000:3.0:1788620114.221738:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001130fe61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5820:x1875504061745408:12345-0@lo:503: Request processed in 591us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620114.221746:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620114.221882:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea6c3eba pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745408:0@lo:503: 00000100:00100000:1.0:1788620114.222600:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5868:1875504061745536:0@lo:502: 00000100:00100000:1.0:1788620114.222649:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620114.222686:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5a20301 going to sleep for 11 seconds 00000100:00100000:3.0:1788620114.222797:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745536 00000100:00100000:3.0:1788620114.222820:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745536 00000100:00100000:3.0:1788620114.222862:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788620114.222869:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d30ebc5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5868:x1875504061745536:12345-0@lo:502: 00000100:00100000:3.0:1788620114.223107:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d30ebc5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5868:x1875504061745536:12345-0@lo:502: Request processed in 239us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620114.223114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788620114.223279:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5868:1875504061745536:0@lo:502: 00000020:01000004:1.0:1788620114.223358:0:5868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788620114.223387:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008ddc3e51) 00000020:00000080:1.0:1788620114.223411:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788620114.223485:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb7fef38 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788620114.223489:0:5868:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000eb7fef38 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788620114.223491:0:5868:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000eb7fef38 4 00010000:00080000:1.0:1788620114.223617:0:5868:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000025ff71dd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.111@tcp at head 00010000:00010000:0.0:1788620114.226909:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788620114.228115:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788620114.228152:0:5868:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788620114.228163:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x24857de440bd024b 00000100:00080000:0.0:1788620114.228174:0:5868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620114.228178:0:5868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000025ff71dd using connection 192.168.201.111@tcp/0@lo 00000100:00100000:0.0:1788620114.228211:0:5868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c3d32564 x1875504061745664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788620114.228235:0:5868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788620114.228451:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3d32564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061745664:0@lo:38: 00000100:00100000:2.0:1788620114.228516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620114.228757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745664 00000100:00100000:0.0:1788620114.228765:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745664 00000100:00100000:0.0:1788620114.228796:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620114.228811:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7bb675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061745664:12345-0@lo:38: 00000100:00100000:0.0:1788620114.228870:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7bb675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061745664:12345-0@lo:38: Request processed in 59us (354us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788620114.228886:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620114.229028:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788620114.229036:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000025ff71dd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620114.229040:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788620114.229043:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3d32564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061745664:0@lo:38: 00000100:00100000:0.0:1788620114.229734:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5868:1875504061745792:0@lo:502: 00000100:00100000:0.0:1788620114.229778:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620114.229818:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d08ffb4a going to sleep for 11 seconds 00000100:00100000:1.0:1788620114.229862:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745792 00000100:00100000:1.0:1788620114.229867:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745792 00000100:00100000:1.0:1788620114.229905:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788620114.229912:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ba225b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5868:x1875504061745792:12345-0@lo:502: 00000100:00100000:1.0:1788620114.230112:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ba225b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5868:x1875504061745792:12345-0@lo:502: Request processed in 201us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620114.230128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788620114.230272:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:5868:1875504061745792:0@lo:502: 00000040:00080000:0.0:1788620114.230294:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788620114.230869:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788620114.230889:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788620114.230909:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: 00000000279e3583/0x24857de440bd0236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620114.230920:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: 00000000279e3583/0x24857de440bd0236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788620114.230974:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788620114.230977:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620114.230978:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620114.230979:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620114.230980:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620114.230982:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620114.230983:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620114.230984:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620114.230986:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788620114.230987:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788620114.230988:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620114.230990:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788620114.230993:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788620114.230996:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788620114.230997:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620114.230999:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620114.231000:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620114.231001:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620114.231002:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620114.231003:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620114.231005:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620114.231005:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788620114.231007:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788620114.231007:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620114.231008:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788620114.231023:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788620114.231033:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745920:0@lo:253: 00000100:00100000:1.0:1788620114.231083:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620114.231112:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5ebea06 going to sleep for 11 seconds 00000100:00100000:0.0:1788620114.231214:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061745920 00000100:00100000:0.0:1788620114.231220:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061745920 00000100:00100000:0.0:1788620114.231278:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788620114.231285:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003530dac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5820:x1875504061745920:12345-0@lo:253: 20000000:01000000:0.0:1788620114.231309:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788620114.231320:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788620114.274558:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788620114.274578:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788620114.274727:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788620114.274732:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788620114.274750:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.274770:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd021a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.274778:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.274827:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd021a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.274840:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd021a expref: 12 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620114.274871:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875504061746048:0@lo:104: 00000100:00100000:0.0:1788620114.274932:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620114.275055:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d08ffb4a going to sleep for 11 seconds 00000100:00100000:3.0:1788620114.275126:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746048 00000100:00100000:3.0:1788620114.275134:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746048 00000100:00100000:3.0:1788620114.275182:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620114.275191:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076292355 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5855:x1875504061746048:12345-0@lo:104: 00010000:00010000:3.0:1788620114.275202:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.275271:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788620114.275277:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076292355 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5855:x1875504061746048:12345-0@lo:104: Request processed in 88us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620114.275283:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788620114.275304:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620114.275309:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.275316:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f32c721 already unused, calling callback (0000000035e7dcf5) 10000000:00010000:3.0:1788620114.275320:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.275712:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620114.275733:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620114.275739:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788620114.275773:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.275781:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620114.275798:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.275816:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: 000000008f32c721/0x24857de440bd021a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0221 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620114.275834:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620114.275835:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620114.275837:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620114.275889:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4553eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061746176:0@lo:103: 00000100:00100000:3.0:1788620114.275921:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620114.276195:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746176 00000100:00100000:0.0:1788620114.276202:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746176 00010000:00010000:0.0:1788620114.276224:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd021a expref: 13 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620114.276277:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620114.276284:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008afa7951 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3309:x1875504061746176:12345-0@lo:103: 00010000:00010000:0.0:1788620114.276295:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620114.276299:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd021a expref: 13 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276308:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd021a expref: 13 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276323:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276400:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788620114.276415:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001683077s 00010000:00010000:0.0:1788620114.276418:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276424:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276439:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276444:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276449:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008781b00c already unused, calling callback (000000003ecde37c) 00010000:00010000:0.0:1788620114.276452:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276457:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276465:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276474:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620114.276509:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008afa7951 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3309:x1875504061746176:12345-0@lo:103: Request processed in 226us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620114.276516:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788620114.276555:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001f4cf671/0x24857de440bd0221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd021a expref: 12 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620114.276565:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875504061746048:0@lo:104: 00010000:00010000:0.0:1788620114.276653:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276662:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276677:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620114.276682:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008781b00c/0x24857de440bd0252 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620114.276809:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4553eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061746176:0@lo:103: 00000100:00100000:2.0:1788620114.285994:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003530dac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5820:x1875504061745920:12345-0@lo:253: Request processed in 54702us (54903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620114.286011:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620114.286139:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ff6e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:5820:1875504061745920:0@lo:253: 10000000:01000000:1.0:1788620114.286155:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788620114.286159:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788620114.286160:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620114.286162:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620114.286163:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620114.286165:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620114.286166:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620114.286168:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620114.286169:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620114.286170:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788620114.286172:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788620114.286174:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620114.286175:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788620114.286189:0:5820:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788620114.292424:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620114.292923:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788620114.293202:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620114.293552:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788620114.293855:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620114.294101:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788620114.295923:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620114.296194:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788620114.296569:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620114.296849:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788620114.297132:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788620114.297473:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788620114.342774:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788620114.386172:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788620114.386571:0:5874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788620114.392149:0:5873:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788620114.392157:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788620114.396299:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788620114.396537:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788620114.396987:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788620114.396995:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788620114.397131:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620114.398080:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788620114.398613:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788620114.398644:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788620114.402557:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788620114.403087:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788620114.405935:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788620114.407882:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788620114.408422:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788620114.408579:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788620114.409183:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788620114.409623:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788620114.409967:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788620114.410115:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788620114.410228:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788620114.410523:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788620114.410712:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788620114.411031:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788620114.411175:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788620114.413070:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788620114.413316:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788620114.413667:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788620114.414401:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788620114.414548:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788620114.414678:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788620114.415108:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788620114.415866:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788620114.416155:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788620114.416393:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788620114.416548:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788620114.416705:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788620114.417278:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788620114.417669:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788620114.418183:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788620114.418511:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788620114.419108:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788620114.419244:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788620114.419712:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788620114.420061:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788620114.443269:0:5874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788620114.492331:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788620114.492982:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd5301dbb988 00100000:10000000:2.0:1788620114.492992:0:5820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788620114.493497:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788620114.493513:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788620114.493528:0:5820:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788620114.493543:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788620114.558667:0:5874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788620114.559845:0:5874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788620114.559853:0:5874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788620115.242517:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620116.265122:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620117.296845:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620118.312899:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620119.336471:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788620119.383661:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788620119.400455:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788620119.400470:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788620119.400473:0:38:0:(import.c:65:import_set_state_nolock()) 0000000025ff71dd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620119.400486:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000025ff71dd using connection 192.168.201.111@tcp/0@lo 00000100:00100000:3.0:1788620119.400518:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003cd56845 x1875504061746432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620119.400681:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620119.400699:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4553eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061746304:0@lo:400: 00000100:00100000:1.0:1788620119.400806:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620119.400870:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cd56845 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061746432:0@lo:38: 00000100:00100000:1.0:1788620119.400901:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620119.400947:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746432 00000100:00100000:1.0:1788620119.400955:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746432 00000100:00100000:1.0:1788620119.400994:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620119.401002:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ff6e8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875504061746432:12345-0@lo:38: 00010000:00080000:1.0:1788620119.401031:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1788620119.401071:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x24857de440bd0259 00000004:00100000:1.0:1788620119.401127:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788620119.401307:0:5841:0:(import.c:65:import_set_state_nolock()) 000000002db2b73d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620119.401365:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ff6e8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875504061746432:12345-0@lo:38: Request processed in 362us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620119.401372:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788620119.401418:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003cd56845 x1875504061746432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788620119.401434:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788620119.401441:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788620119.401446:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788620119.401448:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000025ff71dd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788620119.401454:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cd56845 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061746432:0@lo:38: 00000100:00100000:3.0:1788620119.401821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746304 00000100:00100000:3.0:1788620119.401827:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746304 00000100:00100000:3.0:1788620119.401869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620119.401876:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ef6cd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+11:3311:x1875504061746304:12345-0@lo:400: 00000100:00100000:3.0:1788620119.401919:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ef6cd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+11:3311:x1875504061746304:12345-0@lo:400: Request processed in 44us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620119.401926:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620119.401998:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4553eaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061746304:0@lo:400: 00010000:00010000:3.0:1788620120.363037:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620121.384775:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620122.411797:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788620122.473349:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788620122.473357:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d649f43000 from 3 10000000:01000000:2.0:1788620122.473363:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788620122.473405:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 0000000023b14dcf/0x24857de440bd0260 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620122.473417:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 0000000023b14dcf/0x24857de440bd0260 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620122.473428:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 0000000023b14dcf/0x24857de440bd0260 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620122.473530:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e87dcb24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061746560:0@lo:101: 00000100:00100000:2.0:1788620122.473603:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620122.473665:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a0ca492 going to sleep for 11 seconds 00000100:00100000:3.0:1788620122.473738:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746560 00000100:00100000:3.0:1788620122.473747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746560 00000100:00100000:3.0:1788620122.473794:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788620122.473802:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043361130 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5836:x1875504061746560:12345-0@lo:101: 00010000:00010000:3.0:1788620122.473815:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620122.473826:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007460ab1a/0x24857de440bd0267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0260 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620122.473854:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007460ab1a/0x24857de440bd0267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0260 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620122.473863:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007460ab1a/0x24857de440bd0267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0260 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620122.473889:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007460ab1a, rc 0) 00000100:00100000:3.0:1788620122.473933:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043361130 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061746560:12345-0@lo:101: Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620122.473939:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620122.474069:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e87dcb24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061746560:0@lo:101: 00010000:00010000:0.0:1788620122.474088:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 0000000023b14dcf/0x24857de440bd0260 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620122.474096:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 0000000023b14dcf/0x24857de440bd0260 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620122.474140:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061746688:0@lo:256: 00000100:00100000:0.0:1788620122.474168:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620122.474197:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000005014822a going to sleep for 11 seconds 00000100:00100000:3.0:1788620122.474343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746688 00000100:00100000:3.0:1788620122.474348:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746688 00000100:00100000:3.0:1788620122.474379:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788620122.474385:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dd11b5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061746688:12345-0@lo:256: 20000000:01000000:3.0:1788620122.474398:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788620122.474413:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788620122.474416:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788620122.474689:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dd11b5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061746688:12345-0@lo:256: Request processed in 304us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620122.474696:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788620122.474786:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061746688:0@lo:256: 10000000:01000000:0.0:1788620122.474892:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788620122.474898:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: 0000000023b14dcf/0x24857de440bd0260 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620122.474906:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: 0000000023b14dcf/0x24857de440bd0260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620123.432711:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788620124.152065:0:6318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0f6ab250 20000000:00000080:1.0:1788620124.152085:0:6318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0d6508ccc00 uarg=0000000000000000 20000000:01000000:1.0:1788620124.152123:0:6318:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788620124.152131:0:6318:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788620124.152137:0:6318:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788620124.152656:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788620124.152668:0:6318:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788620124.157520:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620124.157805:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788620124.157864:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788620124.157915:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788620124.158069:0:6318:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788620124.158091:0:6318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620124.158110:0:6318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0228 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620124.158128:0:6318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620124.158167:0:6318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0228 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620124.158185:0:6318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0228 expref: 11 pid: 5832 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620124.158199:0:6318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e68e8ac9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875504061746816:0@lo:104: 00000100:00100000:1.0:1788620124.158327:0:6318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620124.158418:0:6318:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cf4f115 going to sleep for 11 seconds 00000100:00100000:0.0:1788620124.160847:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746816 00000100:00100000:0.0:1788620124.160862:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746816 00000100:00100000:0.0:1788620124.160959:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620124.160970:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081690c37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:6318:x1875504061746816:12345-0@lo:104: 00010000:00010000:0.0:1788620124.160988:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620124.161088:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620124.161093:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081690c37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:6318:x1875504061746816:12345-0@lo:104: Request processed in 127us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620124.161110:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788620124.161152:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620124.161158:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161166:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005871b9a3 already unused, calling callback (0000000035e7dcf5) 10000000:00010000:2.0:1788620124.161169:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161177:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620124.161189:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620124.161195:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620124.161232:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161239:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620124.161315:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161323:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: 000000005871b9a3/0x24857de440bd0228 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd022f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161337:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620124.161338:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620124.161340:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620124.161358:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007347767d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061746944:0@lo:103: 00000100:00100000:2.0:1788620124.161397:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620124.161466:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061746944 00000100:00100000:2.0:1788620124.161471:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061746944 00010000:00010000:2.0:1788620124.161491:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0228 expref: 12 pid: 5832 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620124.161513:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620124.161518:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a13c4fb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:3311:x1875504061746944:12345-0@lo:103: 00010000:00010000:2.0:1788620124.161527:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620124.161531:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0228 expref: 12 pid: 5832 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161546:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0228 expref: 12 pid: 5832 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161563:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161570:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161584:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161590:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161596:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161601:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161606:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3a12690 already unused, calling callback (000000003ecde37c) 00010000:00010000:2.0:1788620124.161609:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161615:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161622:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620124.161654:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620124.161683:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a13c4fb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:3311:x1875504061746944:12345-0@lo:103: Request processed in 165us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620124.161690:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620124.161725:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007347767d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061746944:0@lo:103: 00010000:00010000:0.0:1788620124.162452:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004939215/0x24857de440bd022f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0228 expref: 11 pid: 5832 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620124.162467:0:6318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e68e8ac9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875504061746816:0@lo:104: 00010000:00010000:0.0:1788620124.162485:0:6318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620124.162492:0:6318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620124.162498:0:6318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620124.162503:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3a12690/0x24857de440bd026e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620124.456499:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620124.520803:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bd0bf57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061747072:0@lo:400: 00000100:00100000:2.0:1788620124.520887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620124.522572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747072 00000100:00100000:0.0:1788620124.522584:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747072 00000100:00100000:0.0:1788620124.522646:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620124.522655:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007347767d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061747072:12345-0@lo:400: 00000100:00100000:0.0:1788620124.522741:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007347767d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061747072:12345-0@lo:400: Request processed in 87us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620124.522749:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788620124.522793:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002bd0bf57 x1875504061747072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620124.522807:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bd0bf57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061747072:0@lo:400: 00010000:00010000:2.0:1788620125.480561:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620126.505197:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620127.533214:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620128.552641:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788620128.618725:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788620128.618734:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d649f43000 from 1 10000000:01000000:0.0:1788620128.618738:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620128.618780:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: 0000000004939215/0x24857de440bd0275 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620128.618791:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: 0000000004939215/0x24857de440bd0275 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620128.618801:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: 0000000004939215/0x24857de440bd0275 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620128.618824:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061747200:0@lo:101: 00000100:00100000:0.0:1788620128.618887:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620128.618941:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053b08dda going to sleep for 11 seconds 00000100:00100000:3.0:1788620128.619038:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747200 00000100:00100000:3.0:1788620128.619046:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747200 00000100:00100000:3.0:1788620128.619103:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788620128.619111:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a85923fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+11:5836:x1875504061747200:12345-0@lo:101: 00010000:00010000:3.0:1788620128.619124:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620128.619136:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ec0d10a/0x24857de440bd027c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0275 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620128.619156:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ec0d10a/0x24857de440bd027c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0275 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620128.619165:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ec0d10a/0x24857de440bd027c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0275 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620128.619180:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ec0d10a, rc 0) 00000100:00100000:3.0:1788620128.619218:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a85923fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061747200:12345-0@lo:101: Request processed in 107us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620128.619224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788620128.620967:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061747200:0@lo:101: 00010000:00010000:0.0:1788620128.620990:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: 0000000004939215/0x24857de440bd0275 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620128.620999:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: 0000000004939215/0x24857de440bd0275 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620128.621076:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061747328:0@lo:501: 00000100:00100000:0.0:1788620128.621119:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620128.621163:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053b08dda going to sleep for 11 seconds 00000100:00100000:3.0:1788620128.621267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747328 00000100:00100000:3.0:1788620128.621360:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747328 00000100:00100000:3.0:1788620128.621404:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788620128.621411:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000808c4a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061747328:12345-0@lo:501: 00000100:00100000:3.0:1788620128.621835:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000808c4a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061747328:12345-0@lo:501: Request processed in 423us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620128.621844:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620128.621935:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061747328:0@lo:501: 00000100:00100000:0.0:1788620128.621973:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061747456:0@lo:503: 00000100:00100000:0.0:1788620128.622017:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620128.622053:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053b08dda going to sleep for 11 seconds 00000100:00100000:3.0:1788620128.623901:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747456 00000100:00100000:3.0:1788620128.623914:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747456 00000100:00100000:3.0:1788620128.623963:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788620128.623969:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe03e434 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061747456:12345-0@lo:503: 00000100:00100000:3.0:1788620128.624312:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe03e434 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061747456:12345-0@lo:503: Request processed in 343us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620128.624320:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788620128.624417:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0fcad4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061747456:0@lo:503: 00000100:00100000:1.0:1788620128.627634:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2b38485 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:6651:1875504061747584:0@lo:502: 00000100:00100000:1.0:1788620128.627716:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620128.627768:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c29cfed going to sleep for 11 seconds 00000100:00100000:3.0:1788620128.627833:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747584 00000100:00100000:3.0:1788620128.627841:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747584 00000100:00100000:3.0:1788620128.627890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788620128.627898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068d43d02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6651:x1875504061747584:12345-0@lo:502: 00000100:00100000:3.0:1788620128.628184:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068d43d02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6651:x1875504061747584:12345-0@lo:502: Request processed in 287us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620128.628193:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788620128.628723:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2b38485 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:6651:1875504061747584:0@lo:502: 00000020:01000000:2.0:1788620128.628756:0:6651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620128.628767:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620128.628769:0:6651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788620128.628778:0:6651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d649f43000 00000020:00000080:2.0:1788620128.628781:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788620128.628826:0:6651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:6651:1875504061747712:0@lo:502: 00000100:00100000:2.0:1788620128.628866:0:6651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620128.628891:0:6651:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d643645f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620128.628944:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747712 00000100:00100000:0.0:1788620128.628950:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747712 00000100:00100000:0.0:1788620128.628989:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788620128.628995:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6651:x1875504061747712:12345-0@lo:502: 00000100:00100000:0.0:1788620128.629150:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6651:x1875504061747712:12345-0@lo:502: Request processed in 155us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620128.629158:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788620128.629296:0:6651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:6651:1875504061747712:0@lo:502: 00000020:01000000:2.0:1788620128.629315:0:6651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620128.629319:0:6651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620128.629321:0:6651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788620128.629325:0:6651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788620128.629558:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788620128.629578:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620128.629589:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620128.629601:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788620129.326110:0:6684:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788620129.326114:0:6684:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788620129.326298:0:6684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0d680c0a000 00000020:01000004:0.0:1788620129.326316:0:6684:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788620129.326761:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788620129.326780:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0d664e14d28) 00000020:00000080:0.0:1788620129.326803:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788620129.342579:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788620129.342925:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788620129.364762:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788620129.370888:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788620129.370926:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788620129.370989:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788620129.371031:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788620129.371657:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788620129.371676:0:6684:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788620129.371686:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24857de440bd028a 00000020:01000004:0.0:1788620129.371695:0:6684:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788620129.371716:0:6684:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788620129.371721:0:6684:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788620129.371727:0:6684:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788620129.371733:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788620129.371745:0:6684:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0d664e13370) 00000020:00000080:0.0:1788620129.371755:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788620129.373154:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620129.373374:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788620129.373381:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788620129.374730:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788620129.374740:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788620129.378052:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788620129.378066:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788620129.380185:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620129.382702:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788620129.382712:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788620129.386771:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788620129.386794:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788620129.413529:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620129.413806:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788620129.413814:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788620129.415544:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788620129.415579:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788620129.417081:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788620129.417095:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788620129.419918:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620129.420128:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788620129.420139:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788620129.421058:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788620129.421068:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788620129.519061:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620129.519294:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788620129.519302:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788620129.520720:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788620129.520741:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788620129.522129:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788620129.522160:0:6684:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788620129.522168:0:6684:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788620129.542758:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788620129.542797:0:6684:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.111@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788620129.542802:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788620129.542808:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620129.542809:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620129.542810:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620129.542812:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620129.542813:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620129.542814:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620129.542816:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788620129.542817:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788620129.542819:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620129.542820:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620129.542823:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788620129.542826:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620129.542826:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620129.542827:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620129.542828:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620129.542829:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620129.542830:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620129.542831:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620129.542832:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788620129.542833:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788620129.542834:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620129.542835:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620129.542861:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788620129.542881:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061747840:0@lo:253: 00000100:00100000:2.0:1788620129.542962:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620129.543098:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65070e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620129.543153:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747840 00000100:00100000:0.0:1788620129.543161:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747840 00000100:00100000:0.0:1788620129.543279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620129.543289:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061747840:12345-0@lo:253: 20000000:01000000:0.0:1788620129.543338:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788620129.543345:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788620129.543350:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788620129.543353:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788620129.544899:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620129.545120:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788620129.545133:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788620129.545171:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788620129.545178:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788620129.545206:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788620129.545282:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788620129.545765:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788620129.545783:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.111@tcp 20000000:01000000:1.0:1788620129.545785:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.111@tcp (null) (null) (null) 00000040:00080000:1.0:1788620129.545815:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788620129.545822:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788620129.545867:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788620129.545876:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.111@tcp (null) (null) 00000040:00080000:1.0:1788620129.545909:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788620129.545917:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788620129.545950:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788620129.545998:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788620129.547907:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788620129.547940:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.111@tcp 20000000:01000000:1.0:1788620129.547942:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.111@tcp (null) (null) (null) 00000040:00080000:1.0:1788620129.547977:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788620129.547985:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788620129.548017:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788620129.548025:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.111@tcp (null) (null) 00000040:00080000:1.0:1788620129.548067:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788620129.548076:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788620129.548103:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788620129.548147:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788620129.548163:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788620129.548166:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788620129.548171:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788620129.548173:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788620129.548175:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788620129.548186:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788620129.548188:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788620129.548221:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788620129.548223:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788620129.554774:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788620129.555136:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788620129.555186:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788620129.555303:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788620129.555338:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788620129.555341:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788620129.556242:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788620129.556636:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788620129.556693:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788620129.556957:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788620129.556993:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788620129.557068:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788620129.557081:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788620129.557084:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788620129.557821:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788620129.557870:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788620129.557919:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788620129.558184:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788620129.558220:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788620129.558631:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1788620129.558651:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788620129.558671:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.558689:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641510800/0x24857de440bd01b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd01aa expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.558697:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641643a00/0x24857de440bd01cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd01c6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.558703:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d640031c00/0x24857de440bd023d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0236 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.558721:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.558757:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d640031c00/0x24857de440bd023d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0236 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.558772:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d640031c00/0x24857de440bd023d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0236 expref: 12 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.558786:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061747968:0@lo:104: 00000100:00100000:3.0:1788620129.558853:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620129.558962:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641643a00/0x24857de440bd01cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd01c6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.558971:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641643a00/0x24857de440bd01cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd01c6 expref: 12 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.558980:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061748096:0@lo:104: 00000100:00100000:3.0:1788620129.559003:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620129.559140:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641510800/0x24857de440bd01b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd01aa expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.559147:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641510800/0x24857de440bd01b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd01aa expref: 12 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.559156:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7df480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061748224:0@lo:104: 00000100:00100000:3.0:1788620129.559176:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620129.559194:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061747968 00000100:00100000:0.0:1788620129.559202:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061747968 00000100:00100000:1.0:1788620129.559303:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748096 00000100:00100000:1.0:1788620129.559307:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748096 00000100:00100000:1.0:1788620129.559344:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620129.559353:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:5832:x1875504061747968:12345-0@lo:104: 00010000:00010000:1.0:1788620129.559366:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560012:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620129.560021:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:5832:x1875504061747968:12345-0@lo:104: Request processed in 668us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.560030:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620129.560052:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620129.560061:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061748096:12345-0@lo:104: 00010000:00010000:1.0:1788620129.560070:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560120:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788620129.560126:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061748096:12345-0@lo:104: Request processed in 67us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.560132:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788620129.560150:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620129.560155:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560162:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510000 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620129.560167:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560175:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620129.560183:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620129.560189:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788620129.560219:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560227:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620129.560246:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560281:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641510000/0x24857de440bd0236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd023d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560305:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620129.560309:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560328:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549200 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620129.560331:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560338:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.560493:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1788620129.560592:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620129.560599:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788620129.560614:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560620:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788620129.560660:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061748480:0@lo:103: 00000100:00100000:2.0:1788620129.560699:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788620129.560747:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560755:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c549200/0x24857de440bd01c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd01cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620129.560767:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620129.560769:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620129.560786:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061748352:0@lo:103: 00000100:00100000:1.0:1788620129.560818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.560862:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748480 00000100:00100000:1.0:1788620129.560870:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748480 00010000:00010000:1.0:1788620129.560894:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641643a00/0x24857de440bd01cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd01c6 expref: 13 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620129.560917:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748352 00000100:00100000:1.0:1788620129.560920:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748352 00010000:00010000:1.0:1788620129.560931:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d640031c00/0x24857de440bd023d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0236 expref: 14 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620129.560943:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620129.560949:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:3310:x1875504061748480:12345-0@lo:103: 00010000:00010000:1.0:1788620129.560960:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620129.560966:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641643a00/0x24857de440bd01cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd01c6 expref: 14 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560975:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641643a00/0x24857de440bd01cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd01c6 expref: 14 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.560992:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620129.561212:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748224 00000100:00100000:0.0:1788620129.561217:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748224 00000100:00100000:0.0:1788620129.561239:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620129.561272:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061748224:12345-0@lo:104: 00010000:00010000:0.0:1788620129.561291:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.561351:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620129.561357:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061748224:12345-0@lo:104: Request processed in 112us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620129.561363:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788620129.561593:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620129.561599:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.561616:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643600 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:3.0:1788620129.561620:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.561628:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620129.561635:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620129.561640:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788620129.561668:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.561674:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788620129.561808:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:3310:x1875504061748480:12345-0@lo:103: Request processed in 856us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.561816:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620129.561831:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620129.561838:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3309:x1875504061748352:12345-0@lo:103: 00010000:00010000:1.0:1788620129.561847:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620129.561852:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d640031c00/0x24857de440bd023d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0236 expref: 13 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.561873:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d640031c00/0x24857de440bd023d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0236 expref: 13 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.561886:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620129.561923:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3309:x1875504061748352:12345-0@lo:103: Request processed in 87us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.561930:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620129.561953:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061748608:0@lo:103: 00000100:00100000:1.0:1788620129.561978:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.562013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748608 00000100:00100000:1.0:1788620129.562018:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748608 00010000:00010000:1.0:1788620129.562032:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641510800/0x24857de440bd01b1 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd01aa expref: 13 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620129.562049:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620129.562054:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3311:x1875504061748608:12345-0@lo:103: 00010000:00010000:1.0:1788620129.562060:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620129.562064:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641510800/0x24857de440bd01b1 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd01aa expref: 13 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562073:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641510800/0x24857de440bd01b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd01aa expref: 13 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562085:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562093:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562117:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562123:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562130:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562136:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562141:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620129.562145:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562153:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562160:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562169:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620129.562192:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3311:x1875504061748608:12345-0@lo:103: Request processed in 138us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.562198:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620129.562229:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061748608:0@lo:103: 00000100:00100000:0.0:1788620129.562353:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061748352:0@lo:103: 00010000:00010000:3.0:1788620129.562598:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.562606:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd01aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd01b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.562671:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620129.562674:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620129.562682:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620129.562799:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061748480:0@lo:103: 00000100:00100000:2.0:1788620129.562845:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f2600 going to sleep for 11 seconds 00010000:00010000:2.0:1788620129.562858:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640031c00/0x24857de440bd023d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0236 expref: 12 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620129.562869:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061747968:0@lo:104: 00010000:00010000:2.0:1788620129.562889:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641643a00/0x24857de440bd01cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd01c6 expref: 11 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620129.562898:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061748096:0@lo:104: 00010000:00010000:2.0:1788620129.562908:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641510800/0x24857de440bd01b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd01aa expref: 10 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620129.562916:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7df480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061748224:0@lo:104: 00010000:00010000:2.0:1788620129.562930:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.562938:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.562944:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.562950:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641643200/0x24857de440bd0298 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788620129.562962:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788620129.581512:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620129.621232:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+9:6684:x1875504061747840:12345-0@lo:253: Request processed in 77936us (78262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.621246:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788620129.621461:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061747840:0@lo:253: 10000000:01000000:2.0:1788620129.621477:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788620129.621480:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620129.621481:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620129.621483:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620129.621484:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788620129.621485:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620129.621487:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620129.621488:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620129.621506:0:6684:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788620129.621508:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620129.621510:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788620129.621528:0:6684:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0d680c0a000 from lustre-OST0000 10000000:01000000:2.0:1788620129.621563:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788620129.621566:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788620129.621572:0:6684:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0d664da4d28 local copy 10000000:01000000:2.0:1788620129.621575:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788620129.621608:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.621619:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.621629:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620129.621848:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061748736:0@lo:101: 00000100:00100000:2.0:1788620129.621884:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620129.621930:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65070e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.622000:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748736 00000100:00100000:3.0:1788620129.622008:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748736 00000100:00100000:3.0:1788620129.622048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788620129.622056:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+9:6684:x1875504061748736:12345-0@lo:101: 00010000:00010000:3.0:1788620129.622068:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620129.622079:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641643600/0x24857de440bd02a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd029f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.622111:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641643600/0x24857de440bd02a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd029f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.622120:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641643600/0x24857de440bd02a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd029f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.622129:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643600, rc 0) 00000100:00100000:3.0:1788620129.622162:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+10:6684:x1875504061748736:12345-0@lo:101: Request processed in 106us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.622168:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788620129.622277:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061748736:0@lo:101: 00010000:00010000:2.0:1788620129.622288:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.622297:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620129.622403:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061748864:0@lo:501: 00000100:00100000:2.0:1788620129.622424:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620129.622482:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65070e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620129.622617:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748864 00000100:00100000:1.0:1788620129.622621:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748864 00000100:00100000:1.0:1788620129.622755:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788620129.622763:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+10:6684:x1875504061748864:12345-0@lo:501: 00000100:00100000:1.0:1788620129.622939:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+10:6684:x1875504061748864:12345-0@lo:501: Request processed in 176us (512us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788620129.622946:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788620129.622999:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061748864:0@lo:501: 10000000:01000000:2.0:1788620129.623016:0:6684:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788620129.623037:0:6684:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788620129.623042:0:6684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.623050:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.623057:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.623079:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788620129.623095:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0d680c0a000 10000000:01000000:2.0:1788620129.623099:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788620129.623103:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0d664da4d28 10000000:01000000:2.0:1788620129.623105:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788620129.623107:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0d664da4d28 from 1 10000000:01000000:2.0:1788620129.623110:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788620129.623124:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.623132:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.623140:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620129.623150:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061748992:0@lo:101: 00000100:00100000:2.0:1788620129.623172:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788620129.623213:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620129.623220:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.623228:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510800 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620129.623232:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.623241:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620129.623266:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620129.623273:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788620129.623289:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.623295:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620129.623311:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.623340:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd029f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x24857de440bd02a6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.623354:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620129.623356:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620129.623358:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620129.623365:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620129.623374:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061749120:0@lo:103: 00000100:00100000:0.0:1788620129.623399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620129.623616:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65070e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.628973:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061748992 00000100:00100000:3.0:1788620129.628988:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061748992 00000100:00100000:2.0:1788620129.629112:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788620129.629122:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+10:6684:x1875504061748992:12345-0@lo:101: 00010000:00010000:2.0:1788620129.629139:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620129.629157:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641510e00/0x24857de440bd02b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd02ad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.629184:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641510e00/0x24857de440bd02b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd02ad expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.629196:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641510e00/0x24857de440bd02b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd02ad expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.629206:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641510e00, rc 0) 00000100:00100000:2.0:1788620129.629293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061748992:12345-0@lo:101: Request processed in 172us (6120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620129.629300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788620129.629451:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061748992:0@lo:101: 00010000:00010000:3.0:1788620129.629468:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02b4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.629478:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd02b4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620129.629501:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788620129.629520:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02b4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.629527:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02b4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620129.629544:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788620129.629550:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788620129.629570:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788620129.629573:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788620129.629599:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.629607:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.629615:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.629635:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749248:0@lo:101: 00000100:00100000:3.0:1788620129.629778:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620129.629843:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620129.632340:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061749248 00000100:00100000:1.0:1788620129.632354:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061749248 00000100:00100000:2.0:1788620129.632672:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788620129.632686:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061749248:12345-0@lo:101: 00010000:00010000:2.0:1788620129.632704:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620129.632722:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd02bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.632748:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd02bb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.632759:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd02bb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.632786:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641511600, rc 0) 00000100:00100000:2.0:1788620129.632862:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061749248:12345-0@lo:101: Request processed in 180us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620129.632870:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788620129.632970:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749248:0@lo:101: 00010000:00010000:3.0:1788620129.632989:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.632999:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.633109:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749376:0@lo:501: 00000100:00100000:3.0:1788620129.633141:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620129.633175:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788620129.633231:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061749376 00000100:00100000:2.0:1788620129.633237:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061749376 00000100:00100000:2.0:1788620129.633279:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788620129.633286:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061749376:12345-0@lo:501: 00000100:00100000:2.0:1788620129.633702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061749376:12345-0@lo:501: Request processed in 415us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620129.633709:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788620129.634246:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061749120 00000100:00100000:1.0:1788620129.634270:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061749120 00000100:00100000:1.0:1788620129.634309:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620129.634377:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:3309:x1875504061749120:12345-0@lo:103: 00010000:00010000:1.0:1788620129.634390:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620129.634407:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641643600/0x24857de440bd02a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd029f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.634423:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620129.634463:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:3309:x1875504061749120:12345-0@lo:103: Request processed in 148us (11062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.634470:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620129.634507:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061749120:0@lo:103: 00000100:00100000:3.0:1788620129.634809:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749376:0@lo:501: 00000100:00100000:3.0:1788620129.634849:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749504:0@lo:503: 00000100:00100000:3.0:1788620129.634902:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620129.634938:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788620129.635000:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061749504 00000100:00100000:0.0:1788620129.635006:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061749504 00000100:00100000:0.0:1788620129.635038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788620129.635046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061749504:12345-0@lo:503: 00000100:00100000:0.0:1788620129.635207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061749504:12345-0@lo:503: Request processed in 162us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620129.635214:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788620129.635332:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749504:0@lo:503: 00000040:00080000:3.0:1788620129.635626:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620129.635711:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749632:0@lo:502: 00000100:00100000:3.0:1788620129.635746:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620129.635777:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788620129.635941:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061749632 00000100:00100000:0.0:1788620129.635947:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061749632 00000100:00100000:0.0:1788620129.635985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788620129.635994:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061749632:12345-0@lo:502: 00000100:00100000:0.0:1788620129.636134:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061749632:12345-0@lo:502: Request processed in 141us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620129.636141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788620129.636296:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749632:0@lo:502: 00000040:00080000:3.0:1788620129.637000:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788620129.637058:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788620129.637096:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788620129.637138:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788620129.637169:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788620129.637197:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788620129.637224:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749760:0@lo:502: 00000100:00100000:3.0:1788620129.637469:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620129.637508:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.637543:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061749760 00000100:00100000:3.0:1788620129.637550:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061749760 00000100:00100000:3.0:1788620129.639435:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788620129.639457:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061749760:12345-0@lo:502: 00000100:00100000:3.0:1788620129.639750:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061749760:12345-0@lo:502: Request processed in 302us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.639758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788620129.640580:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061749760:0@lo:502: 00000040:00080000:2.0:1788620129.640754:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788620129.640770:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:1.0:1788620129.641464:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620129.641479:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061749888:0@lo:400: 00000100:00100000:1.0:1788620129.641563:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.641606:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061749888 00000100:00100000:1.0:1788620129.641612:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061749888 00000100:00100000:1.0:1788620129.641664:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620129.641674:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061749888:12345-0@lo:400: 00000100:00100000:1.0:1788620129.641720:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061749888:12345-0@lo:400: Request processed in 48us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.641727:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788620129.641764:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0d680324700 x1875504061749888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620129.641776:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061749888:0@lo:400: 00000020:01000000:2.0:1788620129.641971:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788620129.641979:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788620129.641987:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620129.641989:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788620129.641997:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620129.642014:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0d681a0cd28) 00000020:00000080:2.0:1788620129.642034:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788620129.642040:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788620129.642098:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d680c0a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788620129.642105:0:6702:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788620129.642115:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24857de440bd02d0 00010000:00010000:2.0:1788620129.653181:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788620129.653527:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788620129.656133:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788620129.657025:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788620129.663172:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788620129.664044:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788620129.668742:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788620129.668754:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620129.668761:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620129.668764:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788620129.668775:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620129.668779:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620129.668780:0:6702:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788620129.668784:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788620129.668785:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788620129.668840:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620129.668844:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620129.668845:0:6702:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788620129.668848:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788620129.670822:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788620129.670860:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788620129.670882:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.670894:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620129.670909:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d680c0a000 from 1 10000000:01000000:3.0:1788620129.670912:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620129.670947:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.670955:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.670966:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.670990:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750016:0@lo:101: 00000100:00100000:3.0:1788620129.671059:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620129.676687:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620129.676760:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750016 00000100:00100000:1.0:1788620129.676770:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750016 00000100:00100000:1.0:1788620129.676823:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788620129.676834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:6684:x1875504061750016:12345-0@lo:101: 00010000:00010000:1.0:1788620129.676849:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620129.676867:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd02d7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.676897:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd02d7 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.676909:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd02d7 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.676918:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620129.676986:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750016:12345-0@lo:101: Request processed in 154us (5927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.677005:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788620129.677409:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750016:0@lo:101: 00010000:00010000:0.0:1788620129.677427:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.677436:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620129.677561:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750144:0@lo:501: 00000100:00100000:0.0:1788620129.677596:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620129.677669:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64c379900 going to sleep for 11 seconds 00000100:00100000:2.0:1788620129.677806:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750144 00000100:00100000:2.0:1788620129.677812:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750144 00000100:00100000:2.0:1788620129.677881:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788620129.677890:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750144:12345-0@lo:501: 00000100:00100000:2.0:1788620129.678115:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750144:12345-0@lo:501: Request processed in 227us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620129.678123:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788620129.678186:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750144:0@lo:501: 00000100:00100000:0.0:1788620129.678214:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750272:0@lo:503: 00000100:00100000:0.0:1788620129.678275:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620129.678460:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64c379900 going to sleep for 11 seconds 00000100:00100000:1.0:1788620129.678528:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750272 00000100:00100000:1.0:1788620129.678542:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750272 00000100:00100000:1.0:1788620129.678567:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788620129.678572:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750272:12345-0@lo:503: 00000100:00100000:1.0:1788620129.678885:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750272:12345-0@lo:503: Request processed in 311us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.678892:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788620129.678933:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750272:0@lo:503: 00000040:00080000:1.0:1788620129.679203:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788620129.679305:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750400:0@lo:502: 00000100:00100000:1.0:1788620129.679348:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.679366:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620129.679382:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750400 00000100:00100000:1.0:1788620129.679386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750400 00000100:00100000:1.0:1788620129.679407:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788620129.679413:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750400:12345-0@lo:502: 00000100:00100000:1.0:1788620129.679566:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750400:12345-0@lo:502: Request processed in 152us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620129.679574:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788620129.679610:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750400:0@lo:502: 00000040:00080000:1.0:1788620129.680500:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788620129.680575:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788620129.680605:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750528:0@lo:502: 00000100:00100000:1.0:1788620129.680879:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.680979:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.681053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750528 00000100:00100000:3.0:1788620129.681060:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750528 00000100:00100000:0.0:1788620129.681183:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788620129.681194:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750528:12345-0@lo:502: 00000100:00100000:0.0:1788620129.681439:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750528:12345-0@lo:502: Request processed in 245us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620129.681447:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788620129.681600:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750528:0@lo:502: 00000040:00080000:1.0:1788620129.681845:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788620129.681858:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788620129.682519:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620129.682528:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620129.682541:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788620129.682549:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d680c0a000 00000020:00000080:3.0:1788620129.682552:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620129.682574:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620129.682577:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620129.682579:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788620129.682581:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788620129.682942:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788620129.682968:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788620129.682992:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.683005:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620129.683052:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788620129.683056:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0d680c0a000 10000000:01000000:1.0:1788620129.683059:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0d680c0a000 10000000:01000000:1.0:1788620129.683064:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788620129.683070:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d680c0a000 from 1 10000000:01000000:1.0:1788620129.683073:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788620129.683106:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.683114:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.683125:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620129.683144:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750656:0@lo:101: 00000100:00100000:1.0:1788620129.683204:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.683276:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.683421:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750656 00000100:00100000:3.0:1788620129.683429:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750656 00000100:00100000:3.0:1788620129.683473:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788620129.683482:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061750656:12345-0@lo:101: 00010000:00010000:3.0:1788620129.683504:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620129.683517:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd02e5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.683550:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd02e5 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.683563:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd02e5 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.683571:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643200, rc 0) 00000100:00100000:3.0:1788620129.683619:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061750656:12345-0@lo:101: Request processed in 138us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.683626:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788620129.683793:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750656:0@lo:101: 00010000:00010000:1.0:1788620129.683807:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620129.683815:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620129.683904:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750784:0@lo:501: 00000100:00100000:1.0:1788620129.683929:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.683960:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788620129.684009:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750784 00000100:00100000:2.0:1788620129.684015:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750784 00000100:00100000:2.0:1788620129.684040:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788620129.684047:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061750784:12345-0@lo:501: 00000100:00100000:2.0:1788620129.684282:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061750784:12345-0@lo:501: Request processed in 235us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620129.684289:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788620129.684406:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750784:0@lo:501: 00000100:00100000:1.0:1788620129.684433:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750912:0@lo:503: 00000100:00100000:1.0:1788620129.684469:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.684497:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788620129.684550:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061750912 00000100:00100000:2.0:1788620129.684555:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061750912 00000100:00100000:2.0:1788620129.684587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788620129.684593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061750912:12345-0@lo:503: 00000100:00100000:2.0:1788620129.684879:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061750912:12345-0@lo:503: Request processed in 285us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620129.684886:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788620129.684996:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061750912:0@lo:503: 00000040:00080000:1.0:1788620129.685337:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788620129.685410:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061751040:0@lo:502: 00000100:00100000:1.0:1788620129.685450:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.685478:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.685562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751040 00000100:00100000:3.0:1788620129.685567:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751040 00000100:00100000:3.0:1788620129.685602:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788620129.685611:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061751040:12345-0@lo:502: 00000100:00100000:3.0:1788620129.685921:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061751040:12345-0@lo:502: Request processed in 312us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.685929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788620129.686043:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061751040:0@lo:502: 00000040:00080000:1.0:1788620129.686393:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788620129.686445:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788620129.686483:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788620129.686546:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788620129.686590:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788620129.687122:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788620129.687168:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788620129.687222:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788620129.687303:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788620129.687341:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788620129.687376:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788620129.687424:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788620129.687461:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788620129.687496:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788620129.687573:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788620129.687612:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788620129.687658:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788620129.687709:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788620129.687748:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788620129.687784:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788620129.687847:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788620129.687886:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788620129.687923:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788620129.687989:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788620129.688029:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788620129.688066:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788620129.688124:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788620129.688157:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788620129.688193:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061751168:0@lo:502: 00000100:00100000:1.0:1788620129.688268:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620129.688304:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.688735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751168 00000100:00100000:3.0:1788620129.688742:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751168 00000100:00100000:3.0:1788620129.688786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788620129.688795:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061751168:12345-0@lo:502: 00000100:00100000:3.0:1788620129.688976:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061751168:12345-0@lo:502: Request processed in 182us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.688983:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620129.689084:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061751168:0@lo:502: 00000040:00080000:1.0:1788620129.689145:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788620129.689154:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788620129.689922:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788620129.689939:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0d679b999b8) 00000020:00000080:1.0:1788620129.689959:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788620129.690026:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d680c0a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788620129.690036:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d680c0a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788620129.690039:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d680c0a000 3 00010000:00080000:1.0:1788620129.690067:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d67fb4a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.111@tcp at head 00010000:00010000:1.0:1788620129.691895:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788620129.692087:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788620129.692120:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788620129.692132:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x24857de440bd02fa 00000100:00080000:1.0:1788620129.692141:0:6707:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788620129.692147:0:6707:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0d67fb4a000 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:1.0:1788620129.692179:0:6707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d680324700 x1875504061751296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620129.692284:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875504061751296:0@lo:38: 00000100:00100000:3.0:1788620129.692349:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620129.692440:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751296 00000100:00100000:0.0:1788620129.692448:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751296 00000100:00100000:0.0:1788620129.692485:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788620129.692493:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875504061751296:12345-0@lo:38: 00010000:00080000:0.0:1788620129.692513:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788620129.692553:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x24857de440bd0301 00000004:00100000:0.0:1788620129.692568:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788620129.692595:0:5841:0:(import.c:65:import_set_state_nolock()) ffffa0d679a85000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788620129.692676:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1788620129.700481:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788620129.701031:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788620129.701056:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788620129.701082:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620129.701103:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788620129.701147:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788620129.701149:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620129.701151:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620129.701152:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620129.701154:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620129.701156:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620129.701157:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620129.701160:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788620129.701161:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788620129.701163:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620129.701165:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620129.701169:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788620129.701172:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620129.701173:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620129.701174:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620129.701175:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620129.701176:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620129.701177:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620129.701178:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620129.701179:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788620129.701180:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788620129.701181:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620129.701182:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620129.701212:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788620129.701230:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061751424:0@lo:253: 00000100:00100000:2.0:1788620129.701328:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620129.701371:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751424 00000100:00100000:2.0:1788620129.701379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751424 00000100:00100000:2.0:1788620129.701427:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788620129.701436:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:6684:x1875504061751424:12345-0@lo:253: 20000000:01000000:2.0:1788620129.701464:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788620129.701483:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788620129.702048:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875504061751296:12345-0@lo:38: Request processed in 9550us (9695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620129.702058:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788620129.702166:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0d680324700 x1875504061751296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620129.702178:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788620129.702187:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788620129.702195:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788620129.702199:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788620129.702203:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67fb4a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788620129.702211:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875504061751296:0@lo:38: 00000100:00100000:3.0:1788620129.702313:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6501463c0 going to sleep for 11 seconds 20000000:01000000:3.0:1788620129.732458:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788620129.732512:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788620129.732602:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788620129.732608:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788620129.732628:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.732647:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641642600/0x24857de440bd0267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0260 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.732656:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.732696:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641642600/0x24857de440bd0267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0260 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.732710:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641642600/0x24857de440bd0267 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0260 expref: 13 pid: 5834 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620129.732725:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875504061751552:0@lo:104: 00000100:00100000:0.0:1788620129.732787:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620129.732869:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64c379000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620129.732933:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751552 00000100:00100000:3.0:1788620129.732942:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751552 00000100:00100000:3.0:1788620129.732989:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620129.732998:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5855:x1875504061751552:12345-0@lo:104: 00010000:00010000:3.0:1788620129.733011:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733072:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788620129.733079:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5855:x1875504061751552:12345-0@lo:104: Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.733086:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788620129.733107:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620129.733112:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733132:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511200 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:3.0:1788620129.733136:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733143:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620129.733150:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620129.733155:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788620129.733183:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733190:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620129.733208:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733214:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641511200/0x24857de440bd0260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0267 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733230:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620129.733232:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620129.733234:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620129.733274:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061751680:0@lo:103: 00000100:00100000:3.0:1788620129.733304:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620129.733353:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751680 00000100:00100000:3.0:1788620129.733357:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751680 00010000:00010000:3.0:1788620129.733372:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641642600/0x24857de440bd0267 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0260 expref: 14 pid: 5834 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.733399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620129.733405:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d651421050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:3310:x1875504061751680:12345-0@lo:103: 00010000:00010000:3.0:1788620129.733415:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620129.733420:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641642600/0x24857de440bd0267 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0260 expref: 14 pid: 5834 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733430:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641642600/0x24857de440bd0267 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0260 expref: 14 pid: 5834 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733445:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733452:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788620129.733462:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001683077s 00010000:00010000:3.0:1788620129.733466:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733472:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733478:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733483:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733487:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620129.733490:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733502:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733510:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620129.733518:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620129.733556:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d651421050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:3310:x1875504061751680:12345-0@lo:103: Request processed in 151us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.733563:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620129.733615:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061751680:0@lo:103: 00010000:00010000:0.0:1788620129.733793:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642600/0x24857de440bd0267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0260 expref: 13 pid: 5834 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620129.733803:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875504061751552:0@lo:104: 00010000:00010000:0.0:1788620129.733815:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.733824:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.733830:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620129.733835:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640031000/0x24857de440bd0308 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620129.740777:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:6684:x1875504061751424:12345-0@lo:253: Request processed in 39331us (39438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620129.740792:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788620129.740887:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:6684:1875504061751424:0@lo:253: 10000000:01000000:2.0:1788620129.740904:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788620129.740907:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620129.740909:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620129.740910:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620129.740912:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620129.740913:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620129.740914:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620129.740916:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620129.740917:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788620129.740919:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788620129.740921:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620129.740922:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788620129.740937:0:6684:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788620129.745828:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620129.746013:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620129.746234:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620129.746702:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620129.746932:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620129.747176:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788620129.748379:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788620129.943091:0:6684:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788620129.943098:0:6684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788620129.943130:0:6684:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788620129.943205:0:6684:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788620129.943219:0:6684:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788620129.943240:0:6684:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788620130.600457:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620131.624394:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620132.650476:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620133.672423:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620134.700386:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620134.760427:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620134.760465:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061751808:0@lo:400: 00000100:00100000:1.0:1788620134.760549:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620134.760620:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061751936:0@lo:400: 00000100:00100000:1.0:1788620134.760650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620134.760670:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620134.760676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061752064:0@lo:400: 00000100:00100000:1.0:1788620134.760700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620134.760735:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751808 00000100:00100000:1.0:1788620134.760742:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751808 00000100:00100000:1.0:1788620134.760800:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788620134.760809:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:3310:x1875504061751808:12345-0@lo:400: 00000100:00100000:1.0:1788620134.760865:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:3310:x1875504061751808:12345-0@lo:400: Request processed in 56us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620134.760872:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788620134.760908:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061751936 00000100:00100000:1.0:1788620134.760912:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061751936 00000100:00100000:1.0:1788620134.760944:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752064 00000100:00100000:1.0:1788620134.760947:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752064 00000100:00100000:1.0:1788620134.760972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620134.760978:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061751936:12345-0@lo:400: 00000100:00100000:1.0:1788620134.761016:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061751936:12345-0@lo:400: Request processed in 38us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620134.761022:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620134.761033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620134.761040:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061752064:12345-0@lo:400: 00000100:00100000:1.0:1788620134.761065:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061752064:12345-0@lo:400: Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620134.761071:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788620134.761106:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680326300 x1875504061752064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620134.761120:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061752064:0@lo:400: 00010000:00080000:1.0:1788620134.761131:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680325f80 x1875504061751936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620134.761139:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061751936:0@lo:400: 00000100:00100000:1.0:1788620134.761164:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061751808:0@lo:400: 00000100:00080000:0.0:1788620134.761656:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788620135.721504:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788620136.011783:0:7052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788620136.744782:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620137.768467:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788620138.344535:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788620138.344551:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d649f43000 from 21 10000000:01000000:1.0:1788620138.344558:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788620138.344609:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620138.344621:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620138.344633:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620138.344657:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752192:0@lo:101: 00000100:00100000:1.0:1788620138.344742:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.344827:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620138.345000:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752192 00000100:00100000:3.0:1788620138.345008:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752192 00000100:00100000:3.0:1788620138.345057:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788620138.345068:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061752192:12345-0@lo:101: 00010000:00010000:3.0:1788620138.345102:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620138.345117:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd030f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.345144:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd030f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.345155:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd030f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.345164:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642e00, rc 0) 00000100:00100000:3.0:1788620138.345215:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061752192:12345-0@lo:101: Request processed in 148us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620138.345222:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788620138.347041:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752192:0@lo:101: 00010000:00010000:1.0:1788620138.347067:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620138.347080:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620138.347160:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752320:0@lo:501: 00000100:00100000:1.0:1788620138.347220:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.347303:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620138.347378:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752320 00000100:00100000:0.0:1788620138.347416:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752320 00000100:00100000:0.0:1788620138.347465:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788620138.347475:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061752320:12345-0@lo:501: 00000100:00100000:0.0:1788620138.347866:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061752320:12345-0@lo:501: Request processed in 392us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620138.347874:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788620138.348188:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752320:0@lo:501: 00000100:00100000:1.0:1788620138.348222:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752448:0@lo:503: 00000100:00100000:1.0:1788620138.348311:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.348340:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620138.349554:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752448 00000100:00100000:0.0:1788620138.349564:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752448 00000100:00100000:0.0:1788620138.349618:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788620138.349627:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061752448:12345-0@lo:503: 00000100:00100000:0.0:1788620138.350024:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061752448:12345-0@lo:503: Request processed in 397us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620138.350033:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788620138.350229:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752448:0@lo:503: 00000100:00100000:2.0:1788620138.350848:0:7156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7156:1875504061752576:0@lo:502: 00000100:00100000:2.0:1788620138.350899:0:7156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620138.350937:0:7156:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650094cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620138.350989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752576 00000100:00100000:3.0:1788620138.350994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752576 00000100:00100000:3.0:1788620138.351031:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788620138.351039:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7156:x1875504061752576:12345-0@lo:502: 00000100:00100000:3.0:1788620138.351314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7156:x1875504061752576:12345-0@lo:502: Request processed in 275us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620138.351323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788620138.351455:0:7156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7156:1875504061752576:0@lo:502: 00000100:00100000:2.0:1788620138.351499:0:7156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7156:1875504061752704:0@lo:502: 00000100:00100000:2.0:1788620138.351531:0:7156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620138.351561:0:7156:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650094cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620138.351620:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752704 00000100:00100000:1.0:1788620138.351625:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752704 00000100:00100000:1.0:1788620138.351660:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788620138.351668:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7156:x1875504061752704:12345-0@lo:502: 00000100:00100000:1.0:1788620138.351812:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7156:x1875504061752704:12345-0@lo:502: Request processed in 144us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620138.351819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788620138.351976:0:7156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7156:1875504061752704:0@lo:502: 00000040:00080000:2.0:1788620138.352004:0:7156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788620138.352389:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788620138.352415:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788620138.352426:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620138.352437:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620138.352447:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788620138.352449:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d649f43000 from 4 10000000:01000000:0.0:1788620138.352452:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788620138.352480:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620138.352489:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620138.352498:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620138.352512:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752832:0@lo:101: 00000100:00100000:0.0:1788620138.352561:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620138.352596:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620138.352913:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752832 00000100:00100000:3.0:1788620138.352920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752832 00000100:00100000:3.0:1788620138.352966:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788620138.352974:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061752832:12345-0@lo:101: 00010000:00010000:3.0:1788620138.352984:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620138.352999:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd031d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.353039:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd031d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.353049:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd031d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.353058:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643a00, rc 0) 00000100:00100000:3.0:1788620138.353102:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061752832:12345-0@lo:101: Request processed in 129us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620138.353109:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788620138.354047:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752832:0@lo:101: 00010000:00010000:0.0:1788620138.354071:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620138.354098:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620138.354157:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752960:0@lo:256: 00000100:00100000:0.0:1788620138.354199:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620138.354235:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620138.354288:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061752960 00000100:00100000:3.0:1788620138.354294:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061752960 00000100:00100000:3.0:1788620138.354338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788620138.354346:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061752960:12345-0@lo:256: 20000000:01000000:3.0:1788620138.354361:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788620138.354377:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788620138.354389:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788620138.354477:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061752960:12345-0@lo:256: Request processed in 131us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620138.354484:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788620138.354619:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061752960:0@lo:256: 10000000:01000000:1.0:1788620138.354663:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788620138.354671:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620138.354679:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620138.354688:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788620138.354690:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788620138.354693:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788620138.354715:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620138.354723:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620138.354732:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620138.354754:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061753088:0@lo:101: 00000100:00100000:1.0:1788620138.354779:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.354812:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620138.354864:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753088 00000100:00100000:0.0:1788620138.354869:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753088 00000100:00100000:0.0:1788620138.354896:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788620138.354903:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061753088:12345-0@lo:101: 00010000:00010000:0.0:1788620138.354912:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620138.354924:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd032b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620138.354940:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd032b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620138.354950:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd032b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620138.354959:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031c00, rc 0) 00000100:00100000:0.0:1788620138.354994:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061753088:12345-0@lo:101: Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620138.355000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788620138.355135:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061753088:0@lo:101: 00010000:00010000:1.0:1788620138.355146:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620138.355154:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620138.355219:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061753216:0@lo:501: 00000100:00100000:1.0:1788620138.355244:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.355287:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620138.355337:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753216 00000100:00100000:0.0:1788620138.355342:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753216 00000100:00100000:0.0:1788620138.355369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788620138.355376:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061753216:12345-0@lo:501: 00000100:00100000:0.0:1788620138.355646:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061753216:12345-0@lo:501: Request processed in 270us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620138.355653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788620138.356155:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061753216:0@lo:501: 00000100:00100000:2.0:1788620138.356200:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061753344:0@lo:503: 00000100:00100000:2.0:1788620138.356239:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620138.356300:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650094cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620138.356350:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753344 00000100:00100000:0.0:1788620138.356355:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753344 00000100:00100000:0.0:1788620138.356396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788620138.356403:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061753344:12345-0@lo:503: 00000100:00100000:0.0:1788620138.356706:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061753344:12345-0@lo:503: Request processed in 303us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620138.356714:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788620138.356939:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061753344:0@lo:503: 00000100:00100000:0.0:1788620138.358296:0:7157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7157:1875504061753472:0@lo:502: 00000100:00100000:0.0:1788620138.358365:0:7157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620138.358406:0:7157:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620138.358471:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753472 00000100:00100000:1.0:1788620138.358477:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753472 00000100:00100000:1.0:1788620138.358527:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788620138.358536:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7157:x1875504061753472:12345-0@lo:502: 00000100:00100000:1.0:1788620138.358811:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7157:x1875504061753472:12345-0@lo:502: Request processed in 275us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620138.358819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788620138.359008:0:7157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7157:1875504061753472:0@lo:502: 00000020:01000000:2.0:1788620138.359036:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788620138.359044:0:7157:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788620138.359051:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620138.359053:0:7157:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788620138.359060:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788620138.359064:0:7157:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.111@tcp to nid 0x20000c0a8c96f (192.168.201.111@tcp) 00000020:01000000:2.0:1788620138.359086:0:7157:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788620138.359089:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620138.359106:0:7157:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0d681a0b370) 00000020:00000080:2.0:1788620138.359127:0:7157:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788620138.359133:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788620138.359214:0:7157:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788620138.359220:0:7157:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788620138.359227:0:7157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd0340 00010000:00080000:2.0:1788620138.359272:0:7157:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d67fae6800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.111@tcp at head 00010000:00010000:2.0:1788620138.359598:0:7157:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788620138.445937:0:7157:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788620138.445964:0:7157:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788620138.449058:0:7157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620138.449298:0:7157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620138.449360:0:7157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788620138.449458:0:7157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788620138.451569:0:7159:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788620138.451577:0:7159:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788620138.452767:0:7157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788620138.452781:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788620138.452816:0:7157:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788620138.452841:0:7157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd0347 00000100:00080000:2.0:1788620138.452853:0:7157:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788620138.452859:0:7157:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0d67fae6800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:2.0:1788620138.452896:0:7157:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d645183800 x1875504061753600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788620138.452924:0:7157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788620138.452987:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620138.452991:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620138.452992:0:7157:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788620138.452995:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620138.452998:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620138.452999:0:7157:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788620138.453002:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788620138.453003:0:7157:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788620138.453030:0:7157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7157:1875504061753728:0@lo:502: 00000100:00100000:2.0:1788620138.453123:0:7157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620138.453679:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061753856:0@lo:400: 00000100:00100000:0.0:1788620138.453718:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620138.453770:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620138.453776:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061753984:0@lo:400: 00000100:00100000:0.0:1788620138.453804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620138.453844:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753856 00000100:00100000:0.0:1788620138.453852:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753856 00000100:00100000:0.0:1788620138.453893:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753984 00000100:00100000:0.0:1788620138.453896:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753984 00000100:00100000:0.0:1788620138.453922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620138.453930:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061753856:12345-0@lo:400: 00000100:00100000:0.0:1788620138.453985:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061753856:12345-0@lo:400: Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620138.453994:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620138.454021:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620138.454027:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061753984:12345-0@lo:400: 00000100:00100000:0.0:1788620138.454057:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061753984:12345-0@lo:400: Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620138.454063:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788620138.454086:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788620138.454112:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d664e09500 x1875504061753984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620138.454129:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061753984:0@lo:400: 00010000:00080000:0.0:1788620138.454140:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d664e08380 x1875504061753856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620138.454148:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061753856:0@lo:400: 00000100:00100000:3.0:1788620138.454610:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061753600:0@lo:8: 00000100:00100000:3.0:1788620138.454663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.454770:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753600 00000100:00100000:1.0:1788620138.454776:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753600 00000100:00100000:1.0:1788620138.454812:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620138.454818:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875504061753600:12345-0@lo:8: 00010000:00080000:1.0:1788620138.454854:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1788620138.454886:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd034e 00002000:00100000:1.0:1788620138.454932:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0d67fb4c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788620138.454936:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788620138.454940:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788620138.455075:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788620138.456473:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061753728 00000100:00100000:2.0:1788620138.456484:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061753728 00002000:00080000:1.0:1788620138.456684:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788620138.456722:0:6686:0:(import.c:65:import_set_state_nolock()) ffffa0d67fb4d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620138.456825:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875504061753600:12345-0@lo:8: Request processed in 2004us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620138.456834:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620138.456923:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788620138.456932:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7157:x1875504061753728:12345-0@lo:502: 00010000:00080000:3.0:1788620138.457685:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d645183800 x1875504061753600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620138.457700:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788620138.457709:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788620138.457719:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788620138.457734:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788620138.457737:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67fae6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788620138.457750:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788620138.457756:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061753600:0@lo:8: 00000100:00100000:2.0:1788620138.459577:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7157:x1875504061753728:12345-0@lo:502: Request processed in 2638us (6447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620138.459591:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788620138.459663:0:7157:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650094480 going to sleep for 11 seconds 00000100:00100000:2.0:1788620138.459691:0:7157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7157:1875504061753728:0@lo:502: 00000020:01000000:2.0:1788620138.459720:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620138.459729:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620138.459731:0:7157:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788620138.459738:0:7157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:1.0:1788620138.459948:0:7159:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788620138.460092:0:7159:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 188498841110ns, next at 0ns, rc = 0 00000020:01000000:3.0:1788620138.460477:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788620138.460509:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788620138.460521:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.460533:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620138.460543:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788620138.460545:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0d664da4d28 from 1 10000000:01000000:3.0:1788620138.460548:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788620138.460582:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.460591:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620138.460601:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620138.460622:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061754112:0@lo:101: 00000100:00100000:3.0:1788620138.460669:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620138.460709:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65042f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788620138.461737:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061754112 00000100:00100000:2.0:1788620138.461747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061754112 00000100:00100000:2.0:1788620138.461787:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788620138.461796:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061754112:12345-0@lo:101: 00010000:00010000:2.0:1788620138.461811:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620138.461824:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0355 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620138.461847:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0355 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620138.461857:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0355 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620138.461867:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641510400, rc 0) 00000100:00100000:2.0:1788620138.461920:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061754112:12345-0@lo:101: Request processed in 125us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620138.461926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788620138.464362:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061754112:0@lo:101: 00010000:00010000:2.0:1788620138.464403:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620138.464417:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620138.466120:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061754240:0@lo:501: 00000100:00100000:2.0:1788620138.467335:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620138.467400:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650094b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620138.469207:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061754240 00000100:00100000:3.0:1788620138.469220:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061754240 00000100:00100000:3.0:1788620138.469287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788620138.469310:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061754240:12345-0@lo:501: 00000100:00100000:3.0:1788620138.469951:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061754240:12345-0@lo:501: Request processed in 640us (2617us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620138.469960:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788620138.472012:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061754240:0@lo:501: 10000000:01000000:2.0:1788620138.472059:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788620138.472070:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620138.472082:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620138.503041:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788620138.503498:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061754368:0@lo:13: 00000100:00100000:1.0:1788620138.503577:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620138.503721:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061754368 00000100:00100000:2.0:1788620138.503731:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061754368 00000100:00100000:2.0:1788620138.503797:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620138.503807:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061754368:12345-0@lo:13: 00002000:00000024:2.0:1788620138.503843:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:0.0:1788620138.503911:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788620138.503965:0:7160:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788620138.503988:0:7160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061754496:0@lo:7: 00000100:00100000:3.0:1788620138.504018:0:7160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620138.504037:0:7160:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620138.504060:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061754496 00000100:00100000:3.0:1788620138.504064:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061754496 00000100:00100000:3.0:1788620138.504088:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620138.504094:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7160:x1875504061754496:12345-0@lo:7: 00000100:00100000:2.0:1788620138.508148:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875504061754368:12345-0@lo:13: Request processed in 4334us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620138.508261:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788620138.509339:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d67a7df800 x1875504061754368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620138.509366:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061754368:0@lo:13: 00002000:00080000:3.0:1788620138.509617:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788620138.509622:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788620138.509770:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7160:x1875504061754496:12345-0@lo:7: Request processed in 5672us (5748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620138.509780:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788620138.509839:0:7160:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d67a7dca80 x1875504061754496/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788620154 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620138.509850:0:7160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061754496:0@lo:7: 00000004:00080000:1.0:1788620138.509861:0:7160:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788620138.509894:0:7160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061754624:0@lo:5: 00000100:00100000:1.0:1788620138.509931:0:7160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.510017:0:7160:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620138.510070:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061754624 00000100:00100000:2.0:1788620138.510078:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061754624 00000100:00100000:2.0:1788620138.510149:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620138.510396:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7160:x1875504061754624:12345-0@lo:5: 00002000:00080000:2.0:1788620138.510424:0:6686:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788620138.510428:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788620138.510721:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7160:x1875504061754624:12345-0@lo:5: Request processed in 563us (789us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788620138.510736:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788620138.510828:0:7160:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680324a80 x1875504061754624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788620154 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620138.510841:0:7160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061754624:0@lo:5: 00000004:00080000:1.0:1788620138.510850:0:7160:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788620138.510878:0:7160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061754752:0@lo:700: 00000100:00100000:1.0:1788620138.510906:0:7160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620138.510969:0:7160:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620138.511039:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061754752 00000100:00100000:3.0:1788620138.511045:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061754752 00000100:00100000:3.0:1788620138.511116:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620138.511124:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7160:x1875504061754752:12345-0@lo:700: 00000100:00100000:3.0:1788620138.511152:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1875504061754880:0@lo:700: 00000100:00100000:3.0:1788620138.511196:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620138.511217:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d658353780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620138.511351:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061754880 00000100:00100000:1.0:1788620138.511356:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061754880 00000100:00100000:1.0:1788620138.511400:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620138.511407:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1875504061754880:12345-0@lo:700: 40000000:02000000:2.0:1788620138.532004:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788620138.534782:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1875504061754880:12345-0@lo:700: Request processed in 23365us (23575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620138.534803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788620138.534906:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d67a7dc380 x1875504061754880/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788620154 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620138.534923:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1875504061754880:0@lo:700: 40000000:02000000:2.0:1788620138.534936:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1788620138.590779:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788620138.590797:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788620138.590991:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7160:x1875504061754752:12345-0@lo:700: Request processed in 79862us (80078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620138.591004:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788620138.591117:0:7160:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680327800 x1875504061754752/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788620154 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620138.591129:0:7160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788620138.591148:0:7160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061754752:0@lo:700: 00000004:02000040:0.0:1788620138.611664:0:7160:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788620138.614839:0:7160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061755008:0@lo:5: 00000100:00100000:0.0:1788620138.614915:0:7160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620138.614979:0:7160:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64c379a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788620138.615537:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755008 00000100:00100000:2.0:1788620138.615547:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755008 00000100:00100000:2.0:1788620138.615614:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620138.615626:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7160:x1875504061755008:12345-0@lo:5: 00002000:00080000:2.0:1788620138.623137:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788620138.623158:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788620138.627120:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7160:x1875504061755008:12345-0@lo:5: Request processed in 11490us (12197us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788620138.627133:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788620138.627399:0:7160:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d664e08380 x1875504061755008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788620154 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620138.627418:0:7160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7160:1875504061755008:0@lo:5: 00000004:00080000:0.0:1788620138.627432:0:7160:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788620138.793419:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620139.822748:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788620140.428413:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788620140.844434:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620141.869421:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620142.892747:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620143.464688:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061755136:0@lo:400: 00000100:00100000:2.0:1788620143.464695:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061755264:0@lo:400: 00000100:00100000:1.0:1788620143.466177:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061755520:0@lo:400: 00000100:00100000:0.0:1788620143.466345:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061755392:0@lo:400: 00000100:00100000:2.0:1788620143.469595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620143.469718:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755264 00000100:00100000:2.0:1788620143.469727:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755264 00000100:00100000:2.0:1788620143.469780:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620143.469792:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061755264:12345-0@lo:400: 00000100:00100000:2.0:1788620143.469856:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061755264:12345-0@lo:400: Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620143.469863:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788620143.469914:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d645182300 x1875504061755264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620143.469943:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061755264:0@lo:400: 00000100:00100000:1.0:1788620143.470031:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620143.472244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620143.472349:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755392 00000100:00100000:0.0:1788620143.472358:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755392 00000100:00100000:0.0:1788620143.472414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620143.472424:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061755392:12345-0@lo:400: 00000100:00100000:0.0:1788620143.472574:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061755392:12345-0@lo:400: Request processed in 150us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620143.472581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788620143.472603:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788620143.472633:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d645182a00 x1875504061755392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620143.472647:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061755392:0@lo:400: 00000100:00100000:3.0:1788620143.472707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620143.472956:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755136 00000100:00100000:0.0:1788620143.472961:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755136 00000100:00100000:0.0:1788620143.472992:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788620143.472999:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3309:x1875504061755136:12345-0@lo:400: 00000100:00100000:0.0:1788620143.473041:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3309:x1875504061755136:12345-0@lo:400: Request processed in 42us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620143.473048:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788620143.473102:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061755136:0@lo:400: 00000100:00100000:2.0:1788620143.473577:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755520 00000100:00100000:2.0:1788620143.473583:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755520 00000100:00100000:2.0:1788620143.473633:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620143.473641:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061755520:12345-0@lo:400: 00000100:00100000:2.0:1788620143.473695:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061755520:12345-0@lo:400: Request processed in 55us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620143.473702:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788620143.473762:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d645182d80 x1875504061755520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620143.473773:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788620143.473787:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061755520:0@lo:400: 00000100:00080000:0.0:1788620143.473901:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788620143.914372:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620143.976841:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061755648:0@lo:13: 00000100:00100000:3.0:1788620143.976935:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620143.977017:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755648 00000100:00100000:3.0:1788620143.977026:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755648 00000100:00100000:3.0:1788620143.977091:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620143.977102:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061755648:12345-0@lo:13: 00002000:00000024:3.0:1788620143.977146:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620143.977193:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061755648:12345-0@lo:13: Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620143.977203:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788620143.977278:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d67a7ddc00 x1875504061755648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620143.977309:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061755648:0@lo:13: 00010000:00010000:2.0:1788620144.941641:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788620145.511854:0:7622:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788620145.511857:0:7622:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788620145.511947:0:7622:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0d675d13000 00000020:01000004:0.0:1788620145.511960:0:7622:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788620145.511971:0:7622:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788620145.511985:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0d664e10000) 00000020:00000080:0.0:1788620145.511996:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788620145.525923:0:7622:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788620145.526398:0:7622:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788620145.547969:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788620145.557380:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788620145.557417:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788620145.557550:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788620145.557580:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788620145.557967:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788620145.557981:0:7622:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788620145.557991:0:7622:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24857de440bd036a 00000020:01000004:0.0:1788620145.558000:0:7622:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788620145.558021:0:7622:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788620145.558025:0:7622:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788620145.558031:0:7622:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788620145.559188:0:7622:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788620145.559196:0:7622:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788620145.586144:0:7622:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788620145.586186:0:7622:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.111@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788620145.586191:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788620145.586193:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788620145.586194:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620145.586196:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620145.586201:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620145.586202:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620145.586204:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788620145.586205:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788620145.586207:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788620145.586208:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620145.586209:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788620145.586213:0:7622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788620145.586216:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788620145.586217:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788620145.586218:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620145.586218:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620145.586219:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620145.586220:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620145.586221:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788620145.586222:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788620145.586223:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788620145.586223:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620145.586224:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788620145.586414:0:7622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788620145.586508:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061755776:0@lo:253: 00000100:00100000:1.0:1788620145.586591:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620145.586766:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d666f46000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.586824:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755776 00000100:00100000:3.0:1788620145.586833:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755776 00000100:00100000:3.0:1788620145.586923:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788620145.586934:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:7622:x1875504061755776:12345-0@lo:253: 20000000:01000000:3.0:1788620145.586971:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788620145.586975:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788620145.586985:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788620145.586988:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788620145.587912:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620145.588086:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788620145.588099:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788620145.588130:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788620145.588137:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788620145.588159:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788620145.588195:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788620145.588538:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788620145.588554:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.111@tcp 20000000:01000000:3.0:1788620145.588556:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.111@tcp (null) (null) (null) 00000040:00080000:3.0:1788620145.588582:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788620145.588589:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788620145.588642:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788620145.588651:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.111@tcp (null) (null) 00000040:00080000:3.0:1788620145.588685:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788620145.588693:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788620145.588724:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788620145.588774:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788620145.591400:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788620145.591530:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.111@tcp 20000000:01000000:3.0:1788620145.591533:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.111@tcp (null) (null) (null) 00000040:00080000:3.0:1788620145.591574:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788620145.591583:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788620145.591615:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788620145.591689:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.111@tcp (null) (null) 00000040:00080000:3.0:1788620145.591726:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788620145.591737:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788620145.591790:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788620145.591829:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788620145.591849:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788620145.591863:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788620145.591867:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788620145.591880:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788620145.591883:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788620145.591922:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788620145.591924:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788620145.592980:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788620145.593140:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788620145.593862:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788620145.594759:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788620145.594813:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788620145.594881:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788620145.594897:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788620145.594900:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788620145.595805:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788620145.595870:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788620145.595925:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788620145.596572:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788620145.596610:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788620145.596694:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788620145.596707:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788620145.596710:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788620145.597665:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788620145.597740:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788620145.597798:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788620145.598233:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788620145.598316:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788620145.598355:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788620145.598369:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788620145.598371:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788620145.599697:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788620145.599989:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788620145.600033:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788620145.600185:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788620145.600202:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788620145.600204:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788620145.600213:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788620145.600233:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600583:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd02bb expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600594:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd02e5 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600615:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd030f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600694:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd032b expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600702:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0355 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600709:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600750:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0355 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600765:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0355 expref: 16 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.600780:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061755904:0@lo:104: 00000100:00100000:3.0:1788620145.600843:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620145.600925:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd032b expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600933:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd032b expref: 16 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.600941:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756032:0@lo:104: 00010000:00010000:3.0:1788620145.600963:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd030f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.600981:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd030f expref: 16 pid: 5833 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.600990:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756160:0@lo:104: 00010000:00010000:3.0:1788620145.601016:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd02e5 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.601044:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd02e5 expref: 16 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.601053:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756288:0@lo:104: 00010000:00010000:3.0:1788620145.601079:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd02bb expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.601087:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd02bb expref: 16 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.601093:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756416:0@lo:104: 00000100:00100000:3.0:1788620145.601111:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.601739:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788620145.601763:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.601831:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.601892:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620145.602379:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061755904 00000100:00100000:0.0:1788620145.602387:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061755904 00000100:00100000:0.0:1788620145.602515:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756032 00000100:00100000:0.0:1788620145.602519:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756032 00000100:00100000:0.0:1788620145.602533:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756160 00000100:00100000:0.0:1788620145.602536:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756160 00000100:00100000:0.0:1788620145.602550:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620145.602560:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666f55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+5:5832:x1875504061755904:12345-0@lo:104: 00010000:00010000:0.0:1788620145.602577:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.602790:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620145.602798:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666f55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+5:5832:x1875504061755904:12345-0@lo:104: Request processed in 239us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.602805:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620145.602846:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620145.602853:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:5832:x1875504061756032:12345-0@lo:104: 00010000:00010000:0.0:1788620145.602861:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.602895:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788620145.602900:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:5832:x1875504061756032:12345-0@lo:104: Request processed in 48us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.602906:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620145.602919:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788620145.602924:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061756160:12345-0@lo:104: 00010000:00010000:0.0:1788620145.602931:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.602956:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788620145.602961:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061756160:12345-0@lo:104: Request processed in 37us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.602966:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788620145.603029:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788620145.603047:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603055:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620145.603059:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603066:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620145.603073:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620145.603085:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620145.603126:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603133:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620145.603152:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603158:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641642200/0x24857de440bd0355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd035c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603171:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620145.603174:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603179:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549000 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620145.603182:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603188:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620145.603194:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620145.603199:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620145.603211:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603218:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620145.603229:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603236:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c549000/0x24857de440bd032b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603245:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620145.603276:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603284:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548a00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620145.603286:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603293:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620145.603299:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620145.603305:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620145.603318:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603324:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620145.603339:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603345:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c548a00/0x24857de440bd030f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0316 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603355:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620145.603361:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620145.603363:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620145.603370:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620145.603384:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061756544:0@lo:103: 00000100:00100000:2.0:1788620145.603423:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.603471:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620145.603478:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061756672:0@lo:103: 00000100:00100000:2.0:1788620145.603499:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.603528:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061756800:0@lo:103: 00000100:00100000:2.0:1788620145.603548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.603581:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756544 00000100:00100000:2.0:1788620145.603587:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756544 00010000:00010000:2.0:1788620145.603609:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0355 expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620145.603633:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756672 00000100:00100000:2.0:1788620145.603637:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756672 00010000:00010000:2.0:1788620145.603649:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd032b expref: 18 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620145.603661:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756800 00000100:00100000:2.0:1788620145.603663:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756800 00010000:00010000:2.0:1788620145.603673:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd030f expref: 19 pid: 5833 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620145.603685:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620145.603691:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061756544:12345-0@lo:103: 00010000:00010000:2.0:1788620145.603702:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620145.603706:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0355 expref: 19 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603723:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0355 expref: 19 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603739:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620145.603766:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061756544:12345-0@lo:103: Request processed in 76us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620145.603773:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620145.603789:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788620145.603795:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:3310:x1875504061756672:12345-0@lo:103: 00010000:00010000:2.0:1788620145.603803:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620145.603808:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd032b expref: 18 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603816:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd032b expref: 18 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603825:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620145.603845:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:3310:x1875504061756672:12345-0@lo:103: Request processed in 51us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620145.603850:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788620145.603862:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788620145.603867:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3308:x1875504061756800:12345-0@lo:103: 00010000:00010000:2.0:1788620145.603875:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620145.603879:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd030f expref: 17 pid: 5833 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603887:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd030f expref: 17 pid: 5833 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.603903:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620145.603928:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3308:x1875504061756800:12345-0@lo:103: Request processed in 60us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620145.603933:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788620145.603970:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061756800:0@lo:103: 00000100:00100000:2.0:1788620145.603995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061756672:0@lo:103: 00000100:00100000:2.0:1788620145.604001:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061756544:0@lo:103: 00000100:00100000:3.0:1788620145.604389:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.604399:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756288 00000100:00100000:3.0:1788620145.604403:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756288 00000100:00100000:3.0:1788620145.604425:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756416 00000100:00100000:0.0:1788620145.604512:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620145.604521:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061756288:12345-0@lo:104: 00010000:00010000:0.0:1788620145.604531:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.604578:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620145.604584:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061756288:12345-0@lo:104: Request processed in 66us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.604590:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620145.604677:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756416 00000100:00100000:3.0:1788620145.604707:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620145.604721:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061756416:12345-0@lo:104: 00010000:00010000:3.0:1788620145.604729:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.604764:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788620145.604769:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5832:x1875504061756416:12345-0@lo:104: Request processed in 50us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.604775:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788620145.604886:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620145.604892:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.604900:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548200 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620145.604904:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.604912:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620145.604919:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620145.604924:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620145.604959:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.604966:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620145.604992:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.605005:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c548200/0x24857de440bd02e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02ec expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.605019:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620145.605022:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.605027:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643c00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620145.605030:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.605179:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061756928:0@lo:103: 00000100:00100000:3.0:1788620145.605210:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620145.605306:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620145.605373:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061756928 00000100:00100000:0.0:1788620145.605378:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061756928 00010000:00010000:0.0:1788620145.605398:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd02e5 expref: 17 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620145.605428:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620145.605505:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3309:x1875504061756928:12345-0@lo:103: 00010000:00010000:0.0:1788620145.605516:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620145.605521:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd02e5 expref: 17 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.605542:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd02e5 expref: 17 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.605557:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620145.605590:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3309:x1875504061756928:12345-0@lo:103: Request processed in 87us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.605596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620145.605635:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061756928:0@lo:103: 00010000:00010000:2.0:1788620145.605794:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620145.605805:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620145.605812:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788620145.606376:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606384:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620145.606402:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606409:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641643c00/0x24857de440bd02bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02c2 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606425:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620145.606427:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620145.606428:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620145.606464:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061757056:0@lo:103: 00000100:00100000:3.0:1788620145.606503:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.606559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757056 00000100:00100000:3.0:1788620145.606564:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757056 00010000:00010000:3.0:1788620145.606585:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd02bb expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.606627:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620145.606636:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3310:x1875504061757056:12345-0@lo:103: 00010000:00010000:3.0:1788620145.606645:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620145.606649:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd02bb expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606659:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd02bb expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606674:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606682:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606696:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606703:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606710:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606716:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606721:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620145.606725:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606740:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606750:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.606760:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620145.606792:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3310:x1875504061757056:12345-0@lo:103: Request processed in 158us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.606800:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620145.606829:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061757056:0@lo:103: 00010000:00010000:1.0:1788620145.607661:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641510400/0x24857de440bd035c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0355 expref: 16 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620145.607685:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061755904:0@lo:104: 00010000:00010000:1.0:1788620145.607709:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640031c00/0x24857de440bd0332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd032b expref: 15 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620145.607718:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756032:0@lo:104: 00010000:00010000:1.0:1788620145.607727:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642e00/0x24857de440bd0316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd030f expref: 14 pid: 5833 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620145.607736:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756160:0@lo:104: 00010000:00010000:1.0:1788620145.607744:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641643200/0x24857de440bd02ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd02e5 expref: 13 pid: 5832 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620145.607752:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756288:0@lo:104: 00010000:00010000:1.0:1788620145.607760:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641511600/0x24857de440bd02c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd02bb expref: 12 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620145.607769:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5832:1875504061756416:0@lo:104: 00010000:00010000:1.0:1788620145.607790:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620145.607800:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620145.607806:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620145.607812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680925200/0x24857de440bd0371 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788620145.607826:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788620145.664636:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+11:7622:x1875504061755776:12345-0@lo:253: Request processed in 77686us (78028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.664651:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788620145.664813:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061755776:0@lo:253: 10000000:01000000:2.0:1788620145.664828:0:7622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788620145.664831:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620145.664832:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788620145.664834:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620145.664835:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788620145.664836:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620145.664837:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620145.664839:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620145.664840:0:7622:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788620145.664841:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620145.664843:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788620145.664872:0:7622:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0d675d13000 from lustre-OST0001 10000000:01000000:2.0:1788620145.664897:0:7622:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788620145.664900:0:7622:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788620145.664907:0:7622:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0d664da4d28 local copy 10000000:01000000:2.0:1788620145.664911:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788620145.664945:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.664956:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.664965:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620145.664983:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757184:0@lo:101: 00000100:00100000:2.0:1788620145.665019:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.665148:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb13180 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.665208:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757184 00000100:00100000:3.0:1788620145.665215:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757184 00000100:00100000:3.0:1788620145.665283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788620145.665292:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+11:7622:x1875504061757184:12345-0@lo:101: 00010000:00010000:3.0:1788620145.665304:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620145.665318:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924400/0x24857de440bd037f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0378 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.665340:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924400/0x24857de440bd037f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0378 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.665350:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924400/0x24857de440bd037f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0378 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.665370:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924400, rc 0) 00000100:00100000:3.0:1788620145.665409:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757184:12345-0@lo:101: Request processed in 118us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.665415:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788620145.665558:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757184:0@lo:101: 00010000:00010000:2.0:1788620145.665571:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.665579:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620145.665734:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757312:0@lo:501: 00000100:00100000:2.0:1788620145.665762:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.665788:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb13180 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.665836:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757312 00000100:00100000:3.0:1788620145.665840:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757312 00000100:00100000:3.0:1788620145.665871:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788620145.665878:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757312:12345-0@lo:501: 00000100:00100000:3.0:1788620145.666148:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757312:12345-0@lo:501: Request processed in 270us (384us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620145.666155:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788620145.666188:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757312:0@lo:501: 10000000:01000000:3.0:1788620145.666202:0:7622:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788620145.666228:0:7622:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788620145.666233:0:7622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666242:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666283:0:7622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666300:0:7622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788620145.666324:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0d675d13000 10000000:01000000:3.0:1788620145.666329:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788620145.666340:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788620145.666342:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788620145.666346:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788620145.666349:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788620145.666364:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666372:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666380:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.666392:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757440:0@lo:101: 00000100:00100000:3.0:1788620145.666419:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620145.666535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757440 00000100:00100000:0.0:1788620145.666540:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757440 00000100:00100000:0.0:1788620145.666559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788620145.666566:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757440:12345-0@lo:101: 00010000:00010000:0.0:1788620145.666579:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620145.666589:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0386 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.666603:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0386 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.666612:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0386 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.666680:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030c00, rc 0) 00000100:00100000:3.0:1788620145.666717:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f240 going to sleep for 11 seconds 00010000:00010000:3.0:1788620145.666732:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620145.666737:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666744:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511600 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:3.0:1788620145.666748:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666756:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620145.666764:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620145.666769:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788620145.666794:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666801:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620145.666818:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666826:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd0378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x24857de440bd037f expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.666840:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620145.666842:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620145.666844:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620145.666853:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061757568:0@lo:103: 00000100:00100000:0.0:1788620145.667029:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061757440:12345-0@lo:101: Request processed in 463us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620145.667130:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757440:0@lo:101: 00010000:00010000:2.0:1788620145.667140:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620145.667154:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620145.667219:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757696:0@lo:501: 00000100:00100000:2.0:1788620145.667271:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.667295:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620145.667351:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757696 00000100:00100000:1.0:1788620145.667356:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757696 00000100:00100000:0.0:1788620145.667409:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788620145.667602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788620145.667611:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061757696:12345-0@lo:501: 00000100:00100000:1.0:1788620145.667950:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061757696:12345-0@lo:501: Request processed in 340us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.667957:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788620145.668173:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620145.668288:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757568 00000100:00100000:0.0:1788620145.668294:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757568 00000100:00100000:0.0:1788620145.668332:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620145.668339:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3311:x1875504061757568:12345-0@lo:103: 00010000:00010000:0.0:1788620145.668349:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620145.668364:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924400/0x24857de440bd037f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd0378 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.668376:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620145.668419:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:3311:x1875504061757568:12345-0@lo:103: Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.668425:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620145.668539:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061757568:0@lo:103: 00000100:00100000:2.0:1788620145.668744:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757696:0@lo:501: 00000100:00100000:2.0:1788620145.668780:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757824:0@lo:503: 00000100:00100000:2.0:1788620145.668827:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.668879:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.668921:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757824 00000100:00100000:3.0:1788620145.668926:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757824 00000100:00100000:3.0:1788620145.668989:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788620145.668997:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757824:12345-0@lo:503: 00000100:00100000:3.0:1788620145.669177:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757824:12345-0@lo:503: Request processed in 180us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.669184:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788620145.669277:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757824:0@lo:503: 00000040:00080000:2.0:1788620145.669590:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788620145.669664:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757952:0@lo:502: 00000100:00100000:2.0:1788620145.669702:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.670161:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620145.670240:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061757952 00000100:00100000:0.0:1788620145.670247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061757952 00000100:00100000:0.0:1788620145.670301:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788620145.670315:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757952:12345-0@lo:502: 00000100:00100000:0.0:1788620145.670493:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061757952:12345-0@lo:502: Request processed in 179us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.670501:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788620145.670583:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061757952:0@lo:502: 00000040:00080000:2.0:1788620145.670922:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788620145.670976:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788620145.671009:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788620145.671366:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788620145.671413:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788620145.671445:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788620145.671472:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758080:0@lo:502: 00000100:00100000:2.0:1788620145.671515:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.671545:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620145.671692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758080 00000100:00100000:0.0:1788620145.671698:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758080 00000100:00100000:0.0:1788620145.671726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788620145.671733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061758080:12345-0@lo:502: 00000100:00100000:0.0:1788620145.671935:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061758080:12345-0@lo:502: Request processed in 201us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.671943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788620145.672144:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758080:0@lo:502: 00000040:00080000:2.0:1788620145.672231:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788620145.672242:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788620145.673024:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788620145.673033:0:7629:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788620145.673117:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620145.673120:0:7629:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788620145.673125:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620145.673140:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0d681a08000) 00000020:00000080:2.0:1788620145.673162:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788620145.673169:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788620145.673230:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d675d13000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788620145.673237:0:7629:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788620145.673242:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24857de440bd039b 00010000:00010000:2.0:1788620145.677950:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788620145.678507:0:7629:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788620145.681391:0:7629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788620145.681663:0:7629:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788620145.684959:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788620145.685821:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788620145.686909:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788620145.686918:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620145.686923:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620145.686925:0:7629:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788620145.686927:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620145.686930:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620145.686931:0:7629:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788620145.686932:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788620145.686934:0:7629:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788620145.686970:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620145.686972:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620145.686972:0:7629:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788620145.686978:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788620145.691637:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788620145.691688:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788620145.691711:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.691724:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620145.691734:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d675d13000 from 1 10000000:01000000:0.0:1788620145.691736:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620145.691779:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.691787:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.691798:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620145.691839:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758208:0@lo:101: 00000100:00100000:0.0:1788620145.691902:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620145.691937:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1788620145.691968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758208 00000100:00100000:0.0:1788620145.691975:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758208 00000100:00100000:0.0:1788620145.692026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788620145.692046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+12:7622:x1875504061758208:12345-0@lo:101: 00010000:00010000:0.0:1788620145.692058:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620145.692070:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd03a2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.692092:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd03a2 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.692101:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03a2 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.692110:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030e00, rc 0) 00000100:00100000:0.0:1788620145.692143:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758208:12345-0@lo:101: Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.692150:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788620145.692214:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758208:0@lo:101: 00010000:00010000:0.0:1788620145.692228:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.692237:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620145.692386:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758336:0@lo:501: 00000100:00100000:0.0:1788620145.692411:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620145.692434:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620145.692527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758336 00000100:00100000:1.0:1788620145.692533:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758336 00000100:00100000:1.0:1788620145.692568:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788620145.692574:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758336:12345-0@lo:501: 00000100:00100000:1.0:1788620145.692811:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758336:12345-0@lo:501: Request processed in 237us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.692818:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788620145.693935:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758336:0@lo:501: 00000100:00100000:0.0:1788620145.693967:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758464:0@lo:503: 00000100:00100000:0.0:1788620145.694008:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620145.694045:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758464 00000100:00100000:1.0:1788620145.694050:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758464 00000100:00100000:1.0:1788620145.694130:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788620145.694139:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758464:12345-0@lo:503: 00000100:00100000:0.0:1788620145.694449:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620145.694491:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758464:12345-0@lo:503: Request processed in 354us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.694498:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788620145.694590:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758464:0@lo:503: 00000040:00080000:2.0:1788620145.694852:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788620145.694908:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758592:0@lo:502: 00000100:00100000:2.0:1788620145.694945:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.695052:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb13780 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.695087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758592 00000100:00100000:3.0:1788620145.695092:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758592 00000100:00100000:3.0:1788620145.695115:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788620145.695123:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758592:12345-0@lo:502: 00000100:00100000:3.0:1788620145.695379:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758592:12345-0@lo:502: Request processed in 256us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.695387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788620145.695523:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758592:0@lo:502: 00000040:00080000:2.0:1788620145.695760:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788620145.695809:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788620145.695831:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758720:0@lo:502: 00000100:00100000:2.0:1788620145.695868:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620145.695930:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb13780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620145.695964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758720 00000100:00100000:1.0:1788620145.695968:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758720 00000100:00100000:1.0:1788620145.696035:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788620145.696043:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758720:12345-0@lo:502: 00000100:00100000:1.0:1788620145.696205:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758720:12345-0@lo:502: Request processed in 163us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.696218:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788620145.696318:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758720:0@lo:502: 00000040:00080000:2.0:1788620145.696398:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788620145.696407:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788620145.696829:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620145.696837:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620145.696839:0:7633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788620145.696844:0:7633:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d675d13000 00000020:00000080:2.0:1788620145.696847:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620145.696864:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620145.696868:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620145.696869:0:7633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788620145.696872:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788620145.697093:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788620145.697111:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620145.697161:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.697172:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620145.697214:0:7622:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788620145.697217:0:7622:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0d675d13000 10000000:01000000:3.0:1788620145.697220:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0d675d13000 10000000:01000000:3.0:1788620145.697224:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788620145.697229:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d675d13000 from 1 10000000:01000000:3.0:1788620145.697231:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788620145.697287:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.697296:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.697305:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.697321:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758848:0@lo:101: 00000100:00100000:3.0:1788620145.697360:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.697385:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.697400:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758848 00000100:00100000:3.0:1788620145.697405:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758848 00000100:00100000:3.0:1788620145.697436:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788620145.697444:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061758848:12345-0@lo:101: 00010000:00010000:3.0:1788620145.697461:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620145.697473:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd03b0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.697493:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd03b0 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.697503:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03b0 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.697512:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924a00, rc 0) 00000100:00100000:3.0:1788620145.697542:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061758848:12345-0@lo:101: Request processed in 99us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.697549:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788620145.697582:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758848:0@lo:101: 00010000:00010000:3.0:1788620145.697594:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.697603:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620145.697680:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758976:0@lo:501: 00000100:00100000:3.0:1788620145.697702:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.697716:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.697894:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061758976 00000100:00100000:3.0:1788620145.697899:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061758976 00000100:00100000:3.0:1788620145.697920:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788620145.697926:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061758976:12345-0@lo:501: 00000100:00100000:3.0:1788620145.698125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061758976:12345-0@lo:501: Request processed in 198us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.698132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788620145.698165:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061758976:0@lo:501: 00000100:00100000:3.0:1788620145.698187:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061759104:0@lo:503: 00000100:00100000:3.0:1788620145.698221:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.698238:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.698276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061759104 00000100:00100000:3.0:1788620145.698280:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061759104 00000100:00100000:3.0:1788620145.698300:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788620145.698306:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061759104:12345-0@lo:503: 00000100:00100000:3.0:1788620145.698432:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061759104:12345-0@lo:503: Request processed in 125us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.698439:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788620145.698473:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061759104:0@lo:503: 00000040:00080000:3.0:1788620145.698729:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620145.698785:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061759232:0@lo:502: 00000100:00100000:3.0:1788620145.698816:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.698829:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.698841:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061759232 00000100:00100000:3.0:1788620145.698845:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061759232 00000100:00100000:3.0:1788620145.698864:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788620145.698869:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061759232:12345-0@lo:502: 00000100:00100000:3.0:1788620145.699012:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061759232:12345-0@lo:502: Request processed in 142us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.699025:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788620145.699062:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061759232:0@lo:502: 00000040:00080000:3.0:1788620145.699313:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788620145.699361:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788620145.699391:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788620145.699429:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788620145.699460:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788620145.699499:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788620145.699527:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788620145.699557:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788620145.699599:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788620145.699634:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788620145.699679:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788620145.699726:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788620145.699762:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788620145.699791:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788620145.699833:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788620145.699866:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788620145.699897:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788620145.699953:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788620145.699989:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788620145.700021:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788620145.700065:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788620145.700101:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788620145.700132:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788620145.700191:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788620145.700229:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788620145.700295:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788620145.700357:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788620145.700395:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788620145.700429:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788620145.700485:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788620145.700516:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788620145.700546:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788620145.700575:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788620145.700619:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788620145.700653:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788620145.700699:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788620145.700735:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788620145.700770:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061759360:0@lo:502: 00000100:00100000:3.0:1788620145.700829:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.700854:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620145.700876:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061759360 00000100:00100000:3.0:1788620145.700882:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061759360 00000100:00100000:3.0:1788620145.700918:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788620145.700925:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061759360:12345-0@lo:502: 00000100:00100000:3.0:1788620145.701096:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061759360:12345-0@lo:502: Request processed in 171us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620145.701104:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788620145.701150:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061759360:0@lo:502: 00000040:00080000:3.0:1788620145.701207:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788620145.701216:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788620145.701967:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788620145.701982:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0d679b9cd28) 00000020:00000080:1.0:1788620145.702001:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788620145.702065:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d675d13000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788620145.702069:0:7634:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d675d13000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788620145.702072:0:7634:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d675d13000 3 00010000:00080000:1.0:1788620145.702098:0:7634:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d67a544800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.111@tcp at head 00010000:00010000:1.0:1788620145.704202:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788620145.704556:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788620145.704583:0:7634:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788620145.704590:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x24857de440bd03c5 00000100:00080000:1.0:1788620145.704600:0:7634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788620145.704606:0:7634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0d67a544800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:1.0:1788620145.704652:0:7634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d680325500 x1875504061759488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788620145.704684:0:7634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788620145.704823:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061759488:0@lo:38: 00000100:00100000:0.0:1788620145.704875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620145.704949:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061759488 00000100:00100000:1.0:1788620145.704955:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061759488 00000100:00100000:1.0:1788620145.704980:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620145.704985:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061759488:12345-0@lo:38: 00010000:00080000:1.0:1788620145.705003:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1788620145.705025:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x24857de440bd03cc 00000004:00100000:1.0:1788620145.705037:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788620145.705067:0:5839:0:(import.c:65:import_set_state_nolock()) ffffa0d6465f3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620145.705112:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875504061759488:12345-0@lo:38: Request processed in 125us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.705124:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788620145.705185:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680325500 x1875504061759488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620145.705195:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788620145.705201:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788620145.705208:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788620145.705212:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788620145.705214:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67a544800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788620145.705221:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061759488:0@lo:38: 00000100:00100000:1.0:1788620145.705409:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061759744:0@lo:400: 00000100:00100000:1.0:1788620145.705429:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620145.705451:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620145.705454:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061759616:0@lo:400: 00000100:00100000:1.0:1788620145.705468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620145.705480:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620145.705484:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061759872:0@lo:400: 00000100:00100000:1.0:1788620145.705499:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620145.705513:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061759744 00000100:00100000:1.0:1788620145.705515:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061759744 00000100:00100000:1.0:1788620145.705536:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061759616 00000100:00100000:1.0:1788620145.705537:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061759616 00000100:00100000:1.0:1788620145.705545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620145.705549:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061759744:12345-0@lo:400: 00000100:00100000:1.0:1788620145.705571:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061759744:12345-0@lo:400: Request processed in 22us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.705575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620145.705582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620145.705586:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061759616:12345-0@lo:400: 00000100:00100000:1.0:1788620145.705605:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061759616:12345-0@lo:400: Request processed in 19us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.705610:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620145.705627:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061759872 00000100:00100000:1.0:1788620145.705630:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061759872 00000100:00100000:1.0:1788620145.705655:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620145.705661:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061759872:12345-0@lo:400: 00000100:00100000:1.0:1788620145.705702:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061759872:12345-0@lo:400: Request processed in 41us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.705708:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788620145.705733:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d645180e00 x1875504061759616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620145.705743:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061759616:0@lo:400: 00010000:00080000:1.0:1788620145.705752:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d645182680 x1875504061759744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620145.705760:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061759744:0@lo:400: 00010000:00080000:1.0:1788620145.705787:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d645182300 x1875504061759872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620145.705794:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061759872:0@lo:400: 00000040:00080000:1.0:1788620145.705903:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788620145.705999:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7635:1875504061760000:0@lo:901: 00000100:00100000:1.0:1788620145.706020:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620145.706041:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760000 00000100:00100000:1.0:1788620145.706044:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760000 00000100:00100000:1.0:1788620145.706067:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620145.706074:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1875504061760000:12345-0@lo:901: 00000100:00100000:1.0:1788620145.706407:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1875504061760000:12345-0@lo:901: Request processed in 334us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620145.706412:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620145.706427:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d66a69c900 going to sleep for 11 seconds 00010000:00080000:1.0:1788620145.706435:0:7635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680327480 x1875504061760000/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788620161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620145.706450:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7635:1875504061760000:0@lo:901: 00000100:00080000:0.0:1788620145.706569:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620145.706572:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1788620145.706653:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788620145.706681:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788620145.706735:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620145.706746:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788620145.706798:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788620145.706800:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620145.706801:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620145.706802:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620145.706803:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620145.706804:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620145.706805:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620145.706806:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788620145.706807:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788620145.706808:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620145.706809:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788620145.706812:0:7622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788620145.706813:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788620145.706814:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620145.706815:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620145.706815:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620145.706816:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620145.706817:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620145.706817:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620145.706818:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788620145.706819:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788620145.706820:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620145.706820:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788620145.706832:0:7622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788620145.706838:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061760128:0@lo:253: 00000100:00100000:3.0:1788620145.706864:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620145.706889:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788620145.708175:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760128 00000100:00100000:0.0:1788620145.708185:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760128 00000100:00100000:0.0:1788620145.708229:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788620145.708237:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7622:x1875504061760128:12345-0@lo:253: 20000000:01000000:0.0:1788620145.708292:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788620145.708312:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788620145.728229:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788620145.728243:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788620145.728291:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788620145.728295:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788620145.728315:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728334:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd031d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728343:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728378:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd031d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728393:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd031d expref: 14 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620145.728407:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875504061760256:0@lo:104: 00000100:00100000:0.0:1788620145.728467:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620145.728512:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807ed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620145.728533:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760256 00000100:00100000:0.0:1788620145.728540:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760256 00000100:00100000:0.0:1788620145.728586:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620145.728595:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5855:x1875504061760256:12345-0@lo:104: 00010000:00010000:0.0:1788620145.728606:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728656:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620145.728668:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:5855:x1875504061760256:12345-0@lo:104: Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.728675:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788620145.728703:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620145.728709:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728716:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031e00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620145.728720:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728729:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620145.728736:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620145.728741:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788620145.728770:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728775:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620145.728793:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728800:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d640031e00/0x24857de440bd031d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728817:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620145.728819:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620145.728820:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620145.728839:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061760384:0@lo:103: 00000100:00100000:0.0:1788620145.728869:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620145.728905:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760384 00000100:00100000:0.0:1788620145.728909:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760384 00010000:00010000:0.0:1788620145.728927:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd031d expref: 15 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620145.728950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620145.728957:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:3311:x1875504061760384:12345-0@lo:103: 00010000:00010000:0.0:1788620145.728968:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620145.728973:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd031d expref: 15 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728982:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd031d expref: 15 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.728996:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729004:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788620145.729016:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001683077s 00010000:00010000:0.0:1788620145.729021:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729027:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729033:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729048:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729053:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620145.729057:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729064:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729073:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729082:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620145.729113:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:3311:x1875504061760384:12345-0@lo:103: Request processed in 157us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.729120:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620145.729181:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061760384:0@lo:103: 00010000:00010000:0.0:1788620145.729205:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641643a00/0x24857de440bd0324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd031d expref: 14 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620145.729216:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875504061760256:0@lo:104: 00010000:00010000:0.0:1788620145.729226:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729234:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729240:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620145.729287:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640031000/0x24857de440bd03d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620145.741599:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:7622:x1875504061760128:12345-0@lo:253: Request processed in 33352us (34722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620145.741618:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788620145.741707:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e39889e-8996-4811-9fe8-f1c6c0211740:7622:1875504061760128:0@lo:253: 10000000:01000000:3.0:1788620145.741723:0:7622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788620145.741727:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788620145.741728:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620145.741729:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620145.741731:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620145.741732:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620145.741733:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620145.741749:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620145.741751:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788620145.741752:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788620145.741754:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620145.741756:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788620145.741772:0:7622:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788620145.749580:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620145.749845:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620145.750133:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620145.750391:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620145.750601:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620145.750960:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788620145.752589:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788620145.961591:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788620145.992447:0:7622:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788620145.992458:0:7622:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788620145.995010:0:7622:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788620145.995155:0:7622:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788620145.995177:0:7622:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788620145.995210:0:7622:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788620146.985394:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620148.008391:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788620148.206592:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788620148.206600:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d680c0a000 from 30 10000000:01000000:1.0:1788620148.206606:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788620148.206656:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620148.206666:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620148.206678:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620148.206707:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061760512:0@lo:101: 00000100:00100000:1.0:1788620148.206791:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.206856:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6500e8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788620148.207037:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760512 00000100:00100000:3.0:1788620148.207047:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760512 00000100:00100000:3.0:1788620148.207115:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788620148.207127:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061760512:12345-0@lo:101: 00010000:00010000:3.0:1788620148.207142:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620148.207159:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd03da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.207186:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd03da expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.207197:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03da expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.207207:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924c00, rc 0) 00000100:00100000:3.0:1788620148.207290:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061760512:12345-0@lo:101: Request processed in 164us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.207307:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788620148.209511:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061760512:0@lo:101: 00010000:00010000:1.0:1788620148.209540:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620148.209552:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620148.209620:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061760640:0@lo:501: 00000100:00100000:1.0:1788620148.209691:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.209746:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6500e8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788620148.210156:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760640 00000100:00100000:2.0:1788620148.210163:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760640 00000100:00100000:2.0:1788620148.210221:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788620148.210231:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061760640:12345-0@lo:501: 00000100:00100000:2.0:1788620148.212601:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061760640:12345-0@lo:501: Request processed in 2361us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.212616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788620148.213512:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061760640:0@lo:501: 00000100:00100000:1.0:1788620148.213564:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061760768:0@lo:503: 00000100:00100000:1.0:1788620148.213616:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.213657:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6500e8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788620148.213830:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760768 00000100:00100000:2.0:1788620148.213837:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760768 00000100:00100000:2.0:1788620148.213889:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788620148.213898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061760768:12345-0@lo:503: 00000100:00100000:2.0:1788620148.214826:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061760768:12345-0@lo:503: Request processed in 925us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.214836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788620148.214895:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061760768:0@lo:503: 00000100:00100000:2.0:1788620148.215099:0:7769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7769:1875504061760896:0@lo:502: 00000100:00100000:2.0:1788620148.215139:0:7769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.215163:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061760896 00000100:00100000:2.0:1788620148.215168:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061760896 00000100:00100000:2.0:1788620148.215194:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788620148.215201:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7769:x1875504061760896:12345-0@lo:502: 00000100:00100000:1.0:1788620148.216694:0:7769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788620148.219919:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7769:x1875504061760896:12345-0@lo:502: Request processed in 4709us (4770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.219932:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788620148.220223:0:7769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7769:1875504061760896:0@lo:502: 00000100:00100000:1.0:1788620148.220335:0:7769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7769:1875504061761024:0@lo:502: 00000100:00100000:1.0:1788620148.220498:0:7769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.220538:0:7769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6500e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788620148.220922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761024 00000100:00100000:2.0:1788620148.220929:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761024 00000100:00100000:2.0:1788620148.220978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788620148.220986:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7769:x1875504061761024:12345-0@lo:502: 00000100:00100000:2.0:1788620148.221192:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:7769:x1875504061761024:12345-0@lo:502: Request processed in 206us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.221219:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788620148.224107:0:7769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7769:1875504061761024:0@lo:502: 00000040:00080000:1.0:1788620148.224159:0:7769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788620148.225626:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788620148.225654:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788620148.225667:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.225679:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620148.225689:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788620148.225693:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788620148.225696:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788620148.225735:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.225744:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.225753:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620148.225774:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761152:0@lo:101: 00000100:00100000:2.0:1788620148.225839:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.225882:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788620148.225907:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761152 00000100:00100000:2.0:1788620148.225914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761152 00000100:00100000:2.0:1788620148.225965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788620148.225974:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061761152:12345-0@lo:101: 00010000:00010000:2.0:1788620148.227192:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620148.227238:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd03e8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.227288:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd03e8 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.227301:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03e8 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.227310:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641510400, rc 0) 00000100:00100000:2.0:1788620148.229517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061761152:12345-0@lo:101: Request processed in 3532us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.229530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788620148.229622:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761152:0@lo:101: 00010000:00010000:2.0:1788620148.229646:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.229659:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620148.229735:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761280:0@lo:501: 00000100:00100000:2.0:1788620148.229786:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.229824:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620148.230187:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761280 00000100:00100000:1.0:1788620148.230195:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761280 00000100:00100000:1.0:1788620148.230277:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788620148.230288:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061761280:12345-0@lo:501: 00000100:00100000:1.0:1788620148.230656:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061761280:12345-0@lo:501: Request processed in 369us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620148.230664:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788620148.231038:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761280:0@lo:501: 00000100:00100000:2.0:1788620148.231078:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761408:0@lo:503: 00000100:00100000:2.0:1788620148.231125:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.231163:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620148.231720:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761408 00000100:00100000:1.0:1788620148.231727:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761408 00000100:00100000:1.0:1788620148.231771:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788620148.231780:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061761408:12345-0@lo:503: 00000100:00100000:1.0:1788620148.235691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061761408:12345-0@lo:503: Request processed in 3903us (4556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620148.235716:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788620148.238662:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761408:0@lo:503: 00000100:00100000:0.0:1788620148.241200:0:7772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7772:1875504061761536:0@lo:502: 00000100:00100000:0.0:1788620148.241347:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620148.241392:0:7772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6507126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620148.241555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761536 00000100:00100000:1.0:1788620148.241561:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761536 00000100:00100000:1.0:1788620148.241670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788620148.241679:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7772:x1875504061761536:12345-0@lo:502: 00000100:00100000:1.0:1788620148.241942:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7772:x1875504061761536:12345-0@lo:502: Request processed in 263us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620148.241950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788620148.241973:0:7772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7772:1875504061761536:0@lo:502: 00000020:01000000:0.0:1788620148.242001:0:7772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620148.242010:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620148.242013:0:7772:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788620148.242018:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788620148.242020:0:7772:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788620148.242036:0:7772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7772:1875504061761664:0@lo:502: 00000100:00100000:0.0:1788620148.242071:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.242149:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761664 00000100:00100000:3.0:1788620148.242154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761664 00000100:00100000:0.0:1788620148.242163:0:7772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6507126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620148.242189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788620148.242197:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7772:x1875504061761664:12345-0@lo:502: 00000100:00100000:1.0:1788620148.242625:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:7772:x1875504061761664:12345-0@lo:502: Request processed in 428us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620148.242632:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788620148.242693:0:7772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7772:1875504061761664:0@lo:502: 00000020:01000000:2.0:1788620148.242712:0:7772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620148.242717:0:7772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620148.242719:0:7772:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788620148.242726:0:7772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788620148.242897:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788620148.242919:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788620148.242928:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620148.242939:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620148.242949:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788620148.242952:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d649f43000 from 30 10000000:01000000:1.0:1788620148.242955:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788620148.242979:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620148.242988:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620148.243076:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620148.243089:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761792:0@lo:101: 00000100:00100000:1.0:1788620148.243118:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.243178:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d658353540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620148.243220:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761792 00000100:00100000:2.0:1788620148.243225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761792 00000100:00100000:2.0:1788620148.243549:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788620148.243558:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061761792:12345-0@lo:101: 00010000:00010000:2.0:1788620148.243568:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620148.243581:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd03f6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.243603:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd03f6 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.243613:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03f6 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.243622:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641511200, rc 0) 00000100:00100000:2.0:1788620148.243704:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061761792:12345-0@lo:101: Request processed in 147us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.243712:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788620148.243963:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761792:0@lo:101: 00010000:00010000:1.0:1788620148.243977:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620148.243987:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620148.244117:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761920:0@lo:501: 00000100:00100000:1.0:1788620148.244144:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.244220:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d658353540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620148.245234:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061761920 00000100:00100000:2.0:1788620148.245243:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061761920 00000100:00100000:3.0:1788620148.246195:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788620148.246217:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061761920:12345-0@lo:501: 00000100:00100000:3.0:1788620148.246559:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061761920:12345-0@lo:501: Request processed in 354us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.246567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788620148.246586:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061761920:0@lo:501: 00000100:00100000:2.0:1788620148.246631:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762048:0@lo:503: 00000100:00100000:2.0:1788620148.246676:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.246717:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788620148.246760:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762048 00000100:00100000:3.0:1788620148.246768:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762048 00000100:00100000:3.0:1788620148.246799:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788620148.246806:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061762048:12345-0@lo:503: 00000100:00100000:3.0:1788620148.246946:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061762048:12345-0@lo:503: Request processed in 140us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.246952:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788620148.247025:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762048:0@lo:503: 00000100:00100000:0.0:1788620148.247562:0:7774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7774:1875504061762176:0@lo:502: 00000100:00100000:0.0:1788620148.247600:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620148.247659:0:7774:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6507126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620148.247688:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762176 00000100:00100000:3.0:1788620148.247693:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762176 00000100:00100000:3.0:1788620148.247751:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788620148.247759:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:7774:x1875504061762176:12345-0@lo:502: 00000100:00100000:3.0:1788620148.247917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:7774:x1875504061762176:12345-0@lo:502: Request processed in 159us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.247924:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788620148.247982:0:7774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7774:1875504061762176:0@lo:502: 00000100:00100000:0.0:1788620148.248023:0:7774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7774:1875504061762304:0@lo:502: 00000100:00100000:0.0:1788620148.248052:0:7774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620148.248073:0:7774:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6507126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620148.248106:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762304 00000100:00100000:3.0:1788620148.248111:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762304 00000100:00100000:3.0:1788620148.248137:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788620148.248143:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:7774:x1875504061762304:12345-0@lo:502: 00000100:00100000:3.0:1788620148.248463:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:7774:x1875504061762304:12345-0@lo:502: Request processed in 318us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.248470:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788620148.248527:0:7774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7774:1875504061762304:0@lo:502: 00000040:00080000:0.0:1788620148.248547:0:7774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788620148.248873:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788620148.248891:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788620148.248901:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.248913:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620148.248923:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788620148.248925:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d649f43000 from 5 10000000:01000000:3.0:1788620148.248928:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788620148.248955:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.248964:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.248973:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620148.248987:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762432:0@lo:101: 00000100:00100000:3.0:1788620148.249016:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.249048:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad240 going to sleep for 11 seconds 00000100:00100000:0.0:1788620148.249090:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762432 00000100:00100000:0.0:1788620148.249096:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762432 00000100:00100000:0.0:1788620148.249129:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788620148.249137:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061762432:12345-0@lo:101: 00010000:00010000:0.0:1788620148.249146:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620148.249160:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640031000/0x24857de440bd040b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0404 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620148.249180:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640031000/0x24857de440bd040b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0404 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620148.249190:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640031000/0x24857de440bd040b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0404 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620148.249198:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031000, rc 0) 00000100:00100000:0.0:1788620148.249273:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061762432:12345-0@lo:101: Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620148.249279:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788620148.249571:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762432:0@lo:101: 00010000:00010000:2.0:1788620148.249583:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.249589:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620148.249622:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762560:0@lo:256: 00000100:00100000:2.0:1788620148.249645:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.249663:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788620148.249681:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762560 00000100:00100000:3.0:1788620148.249685:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762560 00000100:00100000:3.0:1788620148.249720:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788620148.249727:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061762560:12345-0@lo:256: 20000000:01000000:3.0:1788620148.249747:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788620148.249763:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788620148.249767:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788620148.249841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061762560:12345-0@lo:256: Request processed in 114us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.249848:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788620148.250069:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762560:0@lo:256: 10000000:01000000:2.0:1788620148.250101:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788620148.250106:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.250111:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620148.250116:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788620148.250117:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788620148.250118:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788620148.250131:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.250135:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.250147:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620148.250154:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762688:0@lo:101: 00000100:00100000:2.0:1788620148.250172:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.250195:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788620148.250205:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762688 00000100:00100000:0.0:1788620148.250223:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762688 00000100:00100000:0.0:1788620148.250272:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788620148.250280:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061762688:12345-0@lo:101: 00010000:00010000:0.0:1788620148.250385:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620148.250395:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0412 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620148.250423:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620148.250433:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620148.250439:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031e00, rc 0) 00000100:00100000:0.0:1788620148.250513:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061762688:12345-0@lo:101: Request processed in 234us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620148.250520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788620148.250568:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762688:0@lo:101: 00010000:00010000:3.0:1788620148.250577:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.250585:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620148.250628:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762816:0@lo:501: 00000100:00100000:3.0:1788620148.250654:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.251968:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620148.252082:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762816 00000100:00100000:0.0:1788620148.252091:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762816 00000100:00100000:0.0:1788620148.252140:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788620148.252149:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061762816:12345-0@lo:501: 00000100:00100000:0.0:1788620148.252456:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061762816:12345-0@lo:501: Request processed in 308us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620148.252465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788620148.252506:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762816:0@lo:501: 00000100:00100000:2.0:1788620148.252544:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762944:0@lo:503: 00000100:00100000:2.0:1788620148.252587:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.252610:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788620148.252686:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061762944 00000100:00100000:0.0:1788620148.252691:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061762944 00000100:00100000:0.0:1788620148.252728:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788620148.252735:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061762944:12345-0@lo:503: 00000100:00100000:0.0:1788620148.253020:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061762944:12345-0@lo:503: Request processed in 285us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620148.253026:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788620148.253103:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061762944:0@lo:503: 00000100:00100000:2.0:1788620148.253755:0:7775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7775:1875504061763072:0@lo:502: 00000100:00100000:2.0:1788620148.253792:0:7775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.253826:0:7775:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620148.254707:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763072 00000100:00100000:3.0:1788620148.254717:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763072 00000100:00100000:3.0:1788620148.254760:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788620148.254770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:7775:x1875504061763072:12345-0@lo:502: 00000100:00100000:3.0:1788620148.255044:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:7775:x1875504061763072:12345-0@lo:502: Request processed in 275us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.255051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788620148.255442:0:7775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7775:1875504061763072:0@lo:502: 00000020:01000000:2.0:1788620148.255475:0:7775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788620148.255482:0:7775:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788620148.255490:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620148.255493:0:7775:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788620148.255497:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788620148.255501:0:7775:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.111@tcp to nid 0x20000c0a8c96f (192.168.201.111@tcp) 00000020:01000000:2.0:1788620148.255529:0:7775:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788620148.255532:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620148.255555:0:7775:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0d650643370) 00000020:00000080:2.0:1788620148.255577:0:7775:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788620148.255593:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788620148.255670:0:7775:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788620148.255676:0:7775:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788620148.255682:0:7775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd0427 00010000:00080000:2.0:1788620148.255712:0:7775:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d67fae2000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.111@tcp at head 00010000:00010000:2.0:1788620148.255932:0:7775:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788620148.256307:0:7775:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788620148.256319:0:7775:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788620148.256817:0:7775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620148.257017:0:7775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620148.257446:0:7775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788620148.257515:0:7775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788620148.257833:0:7777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788620148.257838:0:7777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788620148.259937:0:7775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788620148.259949:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788620148.259980:0:7775:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788620148.260003:0:7775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd042e 00000100:00080000:2.0:1788620148.260014:0:7775:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788620148.260020:0:7775:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0d67fae2000 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:2.0:1788620148.260052:0:7775:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d645182a00 x1875504061763200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620148.260109:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061763200:0@lo:8: 00000100:00100000:0.0:1788620148.260178:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788620148.260280:0:7775:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788620148.260281:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763200 00000100:00100000:1.0:1788620148.260291:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763200 00000100:00100000:1.0:1788620148.260334:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000000:2.0:1788620148.260336:0:7775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620148.260340:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788620148.260341:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875504061763200:12345-0@lo:8: 00000020:00000080:2.0:1788620148.260342:0:7775:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788620148.260344:0:7775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620148.260348:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620148.260349:0:7775:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788620148.260352:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788620148.260353:0:7775:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788620148.260375:0:7775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7775:1875504061763328:0@lo:502: 00010000:00080000:1.0:1788620148.260375:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000100:00100000:2.0:1788620148.260417:0:7775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.260445:0:7775:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d666f46600 going to sleep for 11 seconds 00000020:00000080:1.0:1788620148.260577:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd0435 00002000:00100000:1.0:1788620148.260592:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0d67a543000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788620148.260596:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788620148.260608:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788620148.260742:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788620148.260907:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788620148.260932:0:6687:0:(import.c:65:import_set_state_nolock()) ffffa0d67a546800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620148.261770:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763328 00000100:00100000:3.0:1788620148.261777:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763328 00000100:00100000:3.0:1788620148.261821:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788620148.261830:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:7775:x1875504061763328:12345-0@lo:502: 00000100:00100000:3.0:1788620148.262160:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:7775:x1875504061763328:12345-0@lo:502: Request processed in 331us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.262168:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788620148.262227:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061763456:0@lo:400: 00000100:00100000:3.0:1788620148.262535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.262564:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620148.262570:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061763584:0@lo:400: 00000100:00100000:3.0:1788620148.262595:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.262700:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763456 00000100:00100000:3.0:1788620148.262707:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763456 00000100:00100000:3.0:1788620148.262735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763584 00000100:00100000:3.0:1788620148.262739:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763584 00000100:00100000:3.0:1788620148.262764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620148.262771:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061763456:12345-0@lo:400: 00000100:00100000:3.0:1788620148.262810:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061763456:12345-0@lo:400: Request processed in 40us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.262817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620148.262829:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788620148.262835:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061763584:12345-0@lo:400: 00000100:00100000:3.0:1788620148.262862:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061763584:12345-0@lo:400: Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.262868:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788620148.262889:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620148.262932:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7dc000 x1875504061763584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620148.262946:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061763584:0@lo:400: 00010000:00080000:3.0:1788620148.262969:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7ded80 x1875504061763456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620148.262978:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061763456:0@lo:400: 00000100:00100000:2.0:1788620148.263225:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061763712:0@lo:400: 00000100:00100000:2.0:1788620148.263279:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.263303:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620148.263310:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061763840:0@lo:400: 00000100:00100000:2.0:1788620148.263335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620148.263357:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788620148.263365:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788620148.263390:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763840 00000100:00100000:2.0:1788620148.263394:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763840 00000100:00100000:2.0:1788620148.263424:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620148.263430:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061763840:12345-0@lo:400: 00000100:00100000:2.0:1788620148.263466:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061763840:12345-0@lo:400: Request processed in 36us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.263473:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788620148.263489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788620148.263507:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7dce00 x1875504061763840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620148.263518:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061763840:0@lo:400: 00000100:00100000:2.0:1788620148.263545:0:7775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645183800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:7775:1875504061763328:0@lo:502: 00000020:01000000:2.0:1788620148.263575:0:7775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620148.263582:0:7775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620148.263585:0:7775:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788620148.263590:0:7775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1788620148.263599:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763712 00000100:00100000:3.0:1788620148.263603:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763712 00000100:00100000:3.0:1788620148.263639:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788620148.263647:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620148.263653:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061763712:12345-0@lo:400: 00000100:00100000:3.0:1788620148.263689:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061763712:12345-0@lo:400: Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.263695:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1788620148.263712:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788620148.263732:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788620148.263741:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.263751:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620148.263760:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788620148.263762:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0d664da4d28 from 1 10000000:01000000:3.0:1788620148.263765:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788620148.263791:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.263800:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.263807:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620148.263830:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061763968:0@lo:101: 00000100:00100000:3.0:1788620148.263858:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.263890:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788620148.263902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788620148.263919:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7ddc00 x1875504061763712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620148.263930:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061763712:0@lo:400: 00000100:00100000:2.0:1788620148.265951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061763968 00000100:00100000:2.0:1788620148.265966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061763968 00000100:00100000:2.0:1788620148.266022:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788620148.266031:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061763968:12345-0@lo:101: 00010000:00010000:2.0:1788620148.266055:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620148.266073:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd043c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.266100:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd043c expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.266112:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd043c expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620148.266121:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641510000, rc 0) 00000100:00100000:2.0:1788620148.266329:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061763968:12345-0@lo:101: Request processed in 298us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.266336:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788620148.266721:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061763968:0@lo:101: 00010000:00010000:3.0:1788620148.266742:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.266752:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620148.266816:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061764096:0@lo:501: 00000100:00100000:3.0:1788620148.266850:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.266881:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620148.267102:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875504061763200:12345-0@lo:8: Request processed in 6758us (6921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620148.267113:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788620148.267798:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764096 00000100:00100000:2.0:1788620148.267805:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764096 00000100:00100000:2.0:1788620148.267841:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788620148.267850:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061764096:12345-0@lo:501: 00000100:00100000:2.0:1788620148.268093:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061764096:12345-0@lo:501: Request processed in 245us (1241us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788620148.268101:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788620148.268157:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061764096:0@lo:501: 10000000:01000000:3.0:1788620148.268195:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788620148.268203:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620148.268225:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788620148.268805:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d645182a00 x1875504061763200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620148.268816:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788620148.268823:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788620148.268831:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788620148.268837:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788620148.268840:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67fae2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788620148.268874:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788620148.268882:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061763200:0@lo:8: 00000004:00080000:2.0:1788620148.268908:0:7777:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788620148.269018:0:7777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 198307767230ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788620148.311676:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788620148.383635:0:7778:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788620148.383670:0:7778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764352:0@lo:7: 00000100:00100000:1.0:1788620148.383745:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.383790:0:7778:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650633b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620148.383802:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620148.383813:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061764224:0@lo:13: 00000100:00100000:1.0:1788620148.383840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.383870:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764352 00000100:00100000:1.0:1788620148.383877:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764352 00000100:00100000:1.0:1788620148.383931:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620148.383941:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7778:x1875504061764352:12345-0@lo:7: 00000100:00080000:2.0:1788620148.385322:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620148.385347:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764224 00000100:00100000:2.0:1788620148.385355:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764224 00000100:00100000:2.0:1788620148.385396:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620148.385404:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875504061764224:12345-0@lo:13: 00002000:00000024:2.0:1788620148.385434:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788620148.385499:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875504061764224:12345-0@lo:13: Request processed in 96us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620148.385506:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788620148.409421:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680324e00 x1875504061764224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620148.409448:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061764224:0@lo:13: 00002000:00080000:1.0:1788620148.411555:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788620148.411566:0:6686:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788620148.411673:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7778:x1875504061764352:12345-0@lo:7: Request processed in 27729us (27923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620148.411684:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788620148.420200:0:7778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680325180 x1875504061764352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788620164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620148.420233:0:7778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764352:0@lo:7: 00000004:00080000:3.0:1788620148.420272:0:7778:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788620148.420325:0:7778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764480:0@lo:5: 00000100:00100000:3.0:1788620148.420547:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.420603:0:7778:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620148.421956:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764480 00000100:00100000:0.0:1788620148.421967:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764480 00000100:00100000:0.0:1788620148.422290:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620148.422301:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7778:x1875504061764480:12345-0@lo:5: 00002000:00080000:0.0:1788620148.422349:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788620148.422353:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788620148.422729:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7778:x1875504061764480:12345-0@lo:5: Request processed in 429us (2181us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788620148.422736:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788620148.423117:0:7778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7ded80 x1875504061764480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788620164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620148.423134:0:7778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764480:0@lo:5: 00000004:00080000:3.0:1788620148.423147:0:7778:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788620148.423182:0:7778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764608:0@lo:700: 00000100:00100000:3.0:1788620148.423232:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620148.423291:0:7778:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620148.423510:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764608 00000100:00100000:0.0:1788620148.423516:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764608 00000100:00100000:0.0:1788620148.423558:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620148.423565:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7778:x1875504061764608:12345-0@lo:700: 00000100:00100000:0.0:1788620148.423598:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1875504061764736:0@lo:700: 00000100:00100000:0.0:1788620148.423625:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620148.423642:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650324900 going to sleep for 11 seconds 00000100:00100000:3.0:1788620148.423816:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764736 00000100:00100000:3.0:1788620148.423821:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764736 00000100:00100000:3.0:1788620148.424104:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620148.424114:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1875504061764736:12345-0@lo:700: 40000000:02000000:3.0:1788620148.489607:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788620148.499032:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1875504061764736:12345-0@lo:700: Request processed in 74910us (75395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620148.499046:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788620148.499238:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d664e09f80 x1875504061764736/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788620164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620148.499282:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1875504061764736:0@lo:700: 40000000:02000000:2.0:1788620148.499296:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788620148.606466:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7778:x1875504061764608:12345-0@lo:700: Request processed in 182892us (183226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620148.606482:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1788620148.606512:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788620148.606527:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1788620148.606564:0:7778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7dc000 x1875504061764608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788620164 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620148.606577:0:7778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764608:0@lo:700: 00000004:02000040:1.0:1788620148.660805:0:7778:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788620148.663848:0:7778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764864:0@lo:5: 00000100:00100000:1.0:1788620148.663927:0:7778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620148.663992:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764864 00000100:00100000:1.0:1788620148.664001:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764864 00000100:00100000:1.0:1788620148.664058:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788620148.664069:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7778:x1875504061764864:12345-0@lo:5: 00000100:00100000:3.0:1788620148.666415:0:7778:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad600 going to sleep for 11 seconds 00002000:00080000:1.0:1788620148.683782:0:7779:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788620148.683804:0:7779:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788620148.686801:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7778:x1875504061764864:12345-0@lo:5: Request processed in 22727us (22867us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788620148.686814:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788620148.686938:0:7778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680324a80 x1875504061764864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788620164 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620148.686952:0:7778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788620148.686964:0:7778:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0d680324a80 x1875504061764864/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788620164 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620148.686975:0:7778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7778:1875504061764864:0@lo:5: 00000004:00080000:0.0:1788620148.686990:0:7778:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788620149.032620:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620149.097392:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620149.097421:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061764992:0@lo:13: 00000100:00100000:3.0:1788620149.097498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620149.097662:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061764992 00000100:00100000:2.0:1788620149.097672:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061764992 00000100:00100000:2.0:1788620149.097719:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620149.097728:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061764992:12345-0@lo:13: 00002000:00000024:2.0:1788620149.097762:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620149.097822:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061764992:12345-0@lo:13: Request processed in 95us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620149.097830:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788620149.098075:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7dd180 x1875504061764992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620149.098095:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061764992:0@lo:13: 00010000:00010000:3.0:1788620150.056392:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620151.084130:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788620151.722717:0:7984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788620152.107741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620153.129363:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620153.705052:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620153.705095:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061765120:0@lo:13: 00000100:00100000:0.0:1788620153.705178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620153.705432:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061765120 00000100:00100000:2.0:1788620153.705439:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061765120 00000100:00100000:2.0:1788620153.705500:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788620153.705508:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061765120:12345-0@lo:13: 00002000:00000024:2.0:1788620153.705537:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620153.705576:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061765120:12345-0@lo:13: Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620153.705580:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788620153.705697:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d664e08380 x1875504061765120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620153.705713:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061765120:0@lo:13: 00000100:00080000:0.0:1788620153.706530:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620153.708811:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061765376:0@lo:400: 00000100:00100000:1.0:1788620153.708883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620153.708924:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620153.708938:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061765504:0@lo:400: 00000100:00100000:1.0:1788620153.708961:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620153.708986:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061765632:0@lo:400: 00000100:00100000:1.0:1788620153.709011:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620153.709028:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788620153.709033:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061765248:0@lo:400: 00000100:00100000:1.0:1788620153.709076:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620153.709101:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061765760:0@lo:400: 00000100:00100000:1.0:1788620153.709133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620153.709193:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061765632 00000100:00100000:1.0:1788620153.709201:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061765632 00000100:00100000:1.0:1788620153.709337:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620153.709347:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061765632:12345-0@lo:400: 00000100:00100000:1.0:1788620153.709402:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061765632:12345-0@lo:400: Request processed in 57us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620153.709409:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788620153.709430:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788620153.709471:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675ceea00 x1875504061765632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620153.709484:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061765632:0@lo:400: 00000100:00100000:1.0:1788620153.709767:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061765248 00000100:00100000:1.0:1788620153.709772:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061765248 00000100:00100000:1.0:1788620153.709799:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788620153.709805:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061765248:12345-0@lo:400: 00000100:00100000:1.0:1788620153.709843:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061765248:12345-0@lo:400: Request processed in 38us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620153.709859:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788620153.709887:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061765376 00000100:00100000:1.0:1788620153.709893:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061765376 00000100:00100000:1.0:1788620153.709910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061765504 00000100:00100000:1.0:1788620153.709914:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061765504 00000100:00100000:1.0:1788620153.709931:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061765760 00000100:00100000:1.0:1788620153.709934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061765760 00000100:00100000:1.0:1788620153.709945:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788620153.709950:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061765376:12345-0@lo:400: 00000100:00100000:1.0:1788620153.709987:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061765376:12345-0@lo:400: Request processed in 36us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620153.709993:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788620153.710003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620153.710009:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061765504:12345-0@lo:400: 00000100:00100000:1.0:1788620153.710033:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061765504:12345-0@lo:400: Request processed in 24us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620153.710039:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620153.710049:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620153.710055:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061765760:12345-0@lo:400: 00000100:00100000:1.0:1788620153.710098:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061765760:12345-0@lo:400: Request processed in 42us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620153.710104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788620153.710136:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788620153.710155:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675cee300 x1875504061765504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620153.710166:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061765504:0@lo:400: 00010000:00080000:1.0:1788620153.710188:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680324e00 x1875504061765376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620153.710197:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061765376:0@lo:400: 00000100:00100000:1.0:1788620153.710237:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061765248:0@lo:400: 00010000:00080000:1.0:1788620153.710247:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675ceed80 x1875504061765760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620153.710280:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061765760:0@lo:400: 00000001:00080000:1.0:1788620153.787903:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788620154.152418:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620154.216802:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061765888:0@lo:13: 00000100:00100000:1.0:1788620154.216876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620154.217080:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061765888 00000100:00100000:3.0:1788620154.217089:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061765888 00000100:00100000:3.0:1788620154.217150:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620154.217161:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061765888:12345-0@lo:13: 00002000:00000024:3.0:1788620154.217204:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620154.217279:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061765888:12345-0@lo:13: Request processed in 120us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620154.217286:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788620154.217728:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a7dd180 x1875504061765888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620154.217748:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061765888:0@lo:13: 00010000:00010000:2.0:1788620155.181453:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620156.200428:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620156.868714:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.869664:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966016 00000100:00100000:3.0:1788620156.869676:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966016 00000100:00100000:3.0:1788620156.869723:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 109 00000100:00100000:3.0:1788620156.869731:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875504044966016:12345-192.168.201.11@tcp:250: 00010000:00080000:3.0:1788620156.869758:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d14d7bb1-2553-4f3e-b6b5-4e2ce482a163@192.168.201.11@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1788620156.869784:0:5833:0:(genops.c:1385:class_connect()) connect: client d14d7bb1-2553-4f3e-b6b5-4e2ce482a163, cookie 0x24857de440bd044a 00000100:00080000:3.0:1788620156.882095:0:5833:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620156.882172:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+5:2352:x1875504044966016:12345-192.168.201.11@tcp:250: Request processed in 12435us (13462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620156.882185:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 109 00000100:00100000:3.0:1788620156.893416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620156.893500:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966144 00000100:00100000:1.0:1788620156.893509:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966144 00000100:00100000:1.0:1788620156.893558:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 110 00000100:00100000:1.0:1788620156.893567:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+5:5578:x1875504044966144:12345-192.168.201.11@tcp:101: 00010000:00010000:1.0:1788620156.893585:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620156.893604:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2183 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.893631:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.893642:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.893651:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548c00, rc 0) 00000100:00100000:1.0:1788620156.893717:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+6:5578:x1875504044966144:12345-192.168.201.11@tcp:101: Request processed in 151us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620156.893725:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 110 00000100:00100000:0.0:1788620156.898767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.898843:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966272 00000100:00100000:3.0:1788620156.898865:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966272 00000100:00100000:3.0:1788620156.898920:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 111 00000100:00100000:3.0:1788620156.898931:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+6:5578:x1875504044966272:12345-192.168.201.11@tcp:501: 00000100:00100000:3.0:1788620156.899219:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+6:5578:x1875504044966272:12345-192.168.201.11@tcp:501: Request processed in 289us (462us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620156.899228:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 111 00000100:00100000:2.0:1788620156.905442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620156.905488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966400 00000100:00100000:1.0:1788620156.905500:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966400 00000100:00100000:1.0:1788620156.905555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 112 00000100:00100000:1.0:1788620156.905565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+6:5578:x1875504044966400:12345-192.168.201.11@tcp:101: 00010000:00010000:1.0:1788620156.905583:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620156.905600:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b218a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.905628:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.905640:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.905649:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549e00, rc 0) 00000100:00100000:1.0:1788620156.905709:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+7:5578:x1875504044966400:12345-192.168.201.11@tcp:101: Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620156.905717:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 112 00000100:00100000:0.0:1788620156.908524:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620156.908557:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966528 00000100:00100000:0.0:1788620156.908566:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966528 00000100:00100000:0.0:1788620156.908611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 113 00000100:00100000:0.0:1788620156.908620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+7:5578:x1875504044966528:12345-192.168.201.11@tcp:501: 00000100:00100000:0.0:1788620156.908855:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5578:x1875504044966528:12345-192.168.201.11@tcp:501: Request processed in 234us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620156.908863:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 113 00000100:00100000:0.0:1788620156.911045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.911205:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966656 00000100:00100000:3.0:1788620156.911216:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966656 00000100:00100000:3.0:1788620156.913333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 114 00000100:00100000:3.0:1788620156.913348:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5578:x1875504044966656:12345-192.168.201.11@tcp:503: 00000100:00100000:3.0:1788620156.913687:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5578:x1875504044966656:12345-192.168.201.11@tcp:503: Request processed in 342us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620156.913695:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 114 00000100:00100000:1.0:1788620156.916765:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.916830:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966784 00000100:00100000:3.0:1788620156.916847:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966784 00000100:00100000:3.0:1788620156.916898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00100000:3.0:1788620156.916908:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5597:x1875504044966784:12345-192.168.201.11@tcp:502: 00000100:00100000:3.0:1788620156.917152:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5597:x1875504044966784:12345-192.168.201.11@tcp:502: Request processed in 245us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620156.917161:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00100000:0.0:1788620156.932729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.935723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044966912 00000100:00100000:3.0:1788620156.935740:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044966912 00000100:00100000:3.0:1788620156.935793:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 116 00000100:00100000:3.0:1788620156.935802:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5597:x1875504044966912:12345-192.168.201.11@tcp:502: 00000100:00100000:3.0:1788620156.936104:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5597:x1875504044966912:12345-192.168.201.11@tcp:502: Request processed in 301us (3384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620156.936112:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 116 00000100:00100000:0.0:1788620156.941128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620156.941217:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967040 00000100:00100000:1.0:1788620156.941226:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967040 00000100:00100000:1.0:1788620156.941301:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 117 00000100:00100000:1.0:1788620156.941312:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5578:x1875504044967040:12345-192.168.201.11@tcp:101: 00010000:00010000:1.0:1788620156.941330:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620156.941346:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c549c00/0x24857de440bd045f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b21b4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.941389:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c549c00/0x24857de440bd045f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21b4 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.941400:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c549c00/0x24857de440bd045f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21b4 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620156.941409:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549c00, rc 0) 00000100:00100000:1.0:1788620156.941459:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5578:x1875504044967040:12345-192.168.201.11@tcp:101: Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620156.941465:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 117 00000100:00100000:1.0:1788620156.944536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.944633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967168 00000100:00100000:3.0:1788620156.944642:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967168 00000100:00100000:3.0:1788620156.944726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 118 00000100:00100000:3.0:1788620156.944736:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5578:x1875504044967168:12345-192.168.201.11@tcp:256: 20000000:01000000:3.0:1788620156.944762:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788620156.944788:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788620156.944792:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788620156.944795:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788620156.944797:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788620156.947126:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5578:x1875504044967168:12345-192.168.201.11@tcp:256: Request processed in 2380us (2588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620156.947140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 118 00000100:00100000:1.0:1788620156.950804:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.950919:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967296 00000100:00100000:3.0:1788620156.950930:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967296 00000100:00100000:3.0:1788620156.950980:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:3.0:1788620156.950990:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5578:x1875504044967296:12345-192.168.201.11@tcp:101: 00010000:00010000:3.0:1788620156.951008:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620156.951026:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b21bb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620156.951052:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620156.951075:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620156.951093:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925400, rc 0) 00000100:00100000:3.0:1788620156.951146:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5578:x1875504044967296:12345-192.168.201.11@tcp:101: Request processed in 157us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620156.951153:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:3.0:1788620156.952654:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620156.952762:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967424 00000100:00100000:1.0:1788620156.952770:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967424 00000100:00100000:1.0:1788620156.952818:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 120 00000100:00100000:1.0:1788620156.952827:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5578:x1875504044967424:12345-192.168.201.11@tcp:501: 00000100:00100000:1.0:1788620156.953230:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5578:x1875504044967424:12345-192.168.201.11@tcp:501: Request processed in 403us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620156.953238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 120 00000100:00100000:1.0:1788620156.955318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.955595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967552 00000100:00100000:3.0:1788620156.955606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967552 00000100:00100000:1.0:1788620156.955766:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 121 00000100:00100000:1.0:1788620156.956031:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5578:x1875504044967552:12345-192.168.201.11@tcp:503: 00000100:00100000:1.0:1788620156.956449:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5578:x1875504044967552:12345-192.168.201.11@tcp:503: Request processed in 421us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620156.957203:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 121 00000100:00100000:3.0:1788620156.959577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620156.959948:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967680 00000100:00100000:0.0:1788620156.959959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967680 00000100:00100000:0.0:1788620156.960015:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 122 00000100:00100000:0.0:1788620156.960026:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5601:x1875504044967680:12345-192.168.201.11@tcp:502: 00000100:00100000:0.0:1788620156.960377:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5601:x1875504044967680:12345-192.168.201.11@tcp:502: Request processed in 352us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620156.960390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 122 00000100:00100000:2.0:1788620156.963158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620156.963219:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967808 00000100:00100000:3.0:1788620156.963228:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967808 00000100:00100000:3.0:1788620156.963293:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 123 00000100:00100000:3.0:1788620156.963304:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5601:x1875504044967808:12345-192.168.201.11@tcp:502: 00000100:00100000:3.0:1788620156.963484:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5601:x1875504044967808:12345-192.168.201.11@tcp:502: Request processed in 182us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620156.963490:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 123 00000100:00100000:1.0:1788620156.966204:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620156.966605:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044967936 00000100:00100000:2.0:1788620156.966615:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044967936 00000100:00100000:2.0:1788620156.966653:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:2.0:1788620156.966658:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875504044967936:12345-192.168.201.11@tcp:38: 00010000:00080000:2.0:1788620156.966683:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:2.0:1788620156.966720:0:5839:0:(genops.c:1385:class_connect()) connect: client 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a, cookie 0x24857de440bd046d 00000004:00100000:2.0:1788620156.966748:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788620156.966752:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788620156.989206:0:5839:0:(import.c:65:import_set_state_nolock()) ffffa0d675cae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620156.990124:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2352:x1875504044967936:12345-192.168.201.11@tcp:38: Request processed in 23457us (23925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620156.990138:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00010000:00010000:2.0:1788620157.224802:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620158.012379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620158.012430:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620158.012535:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968192 00000100:00100000:1.0:1788620158.012549:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968192 00000100:00100000:1.0:1788620158.012630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968064 00000100:00100000:1.0:1788620158.012633:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968064 00000100:00100000:1.0:1788620158.012652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:1.0:1788620158.012662:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:5578:x1875504044968192:12345-192.168.201.11@tcp:41: 00000004:00000024:1.0:1788620158.012709:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788620158.012776:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:5578:x1875504044968192:12345-192.168.201.11@tcp:41: Request processed in 115us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620158.012784:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:1.0:1788620158.012802:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:1.0:1788620158.012808:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:0:x1875504044968064:12345-192.168.201.11@tcp:41: 00000004:00000024:1.0:1788620158.012819:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788620158.012838:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:0:x1875504044968064:12345-192.168.201.11@tcp:41: Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620158.012844:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00080000:2.0:1788620158.013148:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620158.014956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620158.016179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968320 00000100:00100000:1.0:1788620158.016191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968320 00000100:00100000:1.0:1788620158.016279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:1.0:1788620158.016291:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5578:x1875504044968320:12345-192.168.201.11@tcp:40: 00000100:00100000:1.0:1788620158.016397:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5578:x1875504044968320:12345-192.168.201.11@tcp:40: Request processed in 109us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620158.016404:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:1.0:1788620158.021433:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620158.021480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620158.021534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620158.021570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620158.021605:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968448 00000100:00100000:1.0:1788620158.021616:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968448 00000100:00100000:1.0:1788620158.021650:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968576 00000100:00100000:1.0:1788620158.021653:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968576 00000100:00100000:1.0:1788620158.021673:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:1.0:1788620158.021682:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875504044968448:12345-192.168.201.11@tcp:8: 00000100:00100000:3.0:1788620158.021688:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:3.0:1788620158.021697:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875504044968576:12345-192.168.201.11@tcp:8: 00010000:00080000:1.0:1788620158.021717:0:7779:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp t0 exp 0000000000000000 cur 208 last 0 00010000:00080000:3.0:1788620158.021718:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788620158.021758:0:6686:0:(genops.c:1385:class_connect()) connect: client 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a, cookie 0x24857de440bd047b 00000020:00000080:1.0:1788620158.021760:0:7779:0:(genops.c:1385:class_connect()) connect: client 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a, cookie 0x24857de440bd0474 00002000:00100000:3.0:1788620158.021772:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a/ffffa0d680a2a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788620158.021775:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a/ffffa0d67a544000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788620158.021799:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788620158.021799:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788620158.022171:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968704 00000100:00100000:0.0:1788620158.022176:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968704 00000100:00100000:0.0:1788620158.022228:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 124 00000100:00100000:0.0:1788620158.022238:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044968704:12345-192.168.201.11@tcp:400: 00000100:00100000:0.0:1788620158.022351:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044968704:12345-192.168.201.11@tcp:400: Request processed in 114us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620158.022361:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 124 00002000:00080000:3.0:1788620158.022461:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788620158.022499:0:6686:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620158.022532:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2352:x1875504044968576:12345-192.168.201.11@tcp:8: Request processed in 834us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620158.022538:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:2.0:1788620158.022758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968832 00000100:00100000:2.0:1788620158.022764:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968832 00000100:00100000:2.0:1788620158.022804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:2.0:1788620158.022810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5578:x1875504044968832:12345-192.168.201.11@tcp:33: 00002000:00080000:1.0:1788620158.027324:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788620158.027374:0:7779:0:(import.c:65:import_set_state_nolock()) ffffa0d67a542000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620158.027523:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2352:x1875504044968448:12345-192.168.201.11@tcp:8: Request processed in 5837us (5984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620158.027534:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000004:00080000:1.0:1788620158.056382:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33505us 00000004:00200000:2.0:1788620158.076780:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788620158.076959:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5578:x1875504044968832:12345-192.168.201.11@tcp:33: Request processed in 54143us (55472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620158.076969:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00010000:00010000:3.0:1788620158.248421:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620158.270211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620158.274641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044968960 00000100:00100000:3.0:1788620158.274659:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044968960 00000100:00100000:3.0:1788620158.274741:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:3.0:1788620158.274751:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5618:x1875504044968960:12345-192.168.201.11@tcp:101: 00010000:00010000:3.0:1788620158.274775:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620158.274846:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925000/0x24857de440bd0482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b21e5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620158.274925:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0489 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620158.274939:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620158.274956:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620158.275182:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788620158.275186:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620158.275299:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620158.275329:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925000/0x24857de440bd0482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21e5 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620158.275347:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21e5 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620158.275362:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e000) 00010000:00010000:3.0:1788620158.275365:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620158.275368:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924600, rc 0) 00000100:00100000:3.0:1788620158.275781:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:5618:x1875504044968960:12345-192.168.201.11@tcp:101: Request processed in 1030us (5580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620158.275789:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:2.0:1788620158.826421:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061766016:0@lo:400: 00000100:00100000:3.0:1788620158.826459:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061766272:0@lo:400: 00000100:00100000:1.0:1788620158.826656:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061766400:0@lo:400: 00000100:00100000:0.0:1788620158.830206:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061766144:0@lo:400: 00000100:00100000:3.0:1788620158.832878:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620158.832978:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061766784:0@lo:13: 00000100:00100000:3.0:1788620158.833035:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620158.833090:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766784 00000100:00100000:3.0:1788620158.833100:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766784 00000100:00100000:3.0:1788620158.833163:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620158.833172:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061766784:12345-0@lo:13: 00002000:00000024:3.0:1788620158.833197:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620158.833272:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061766784:12345-0@lo:13: Request processed in 100us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620158.833278:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788620158.833298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620158.833311:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766272 00000100:00100000:3.0:1788620158.833314:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766272 00000100:00100000:3.0:1788620158.833341:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788620158.833347:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061766272:12345-0@lo:400: 00000100:00100000:3.0:1788620158.833376:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061766272:12345-0@lo:400: Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620158.833853:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788620158.833873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620158.833921:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d664e0b480 x1875504061766784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620158.833932:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788620158.833951:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061766784:0@lo:13: 00000100:00100000:3.0:1788620158.833966:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061766272:0@lo:400: 00000100:00100000:2.0:1788620158.837084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620158.837182:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061766528:0@lo:400: 00000100:00100000:2.0:1788620158.837266:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620158.837314:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766528 00000100:00100000:2.0:1788620158.837322:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766528 00000100:00100000:2.0:1788620158.837379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620158.837390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061766528:12345-0@lo:400: 00000100:00100000:2.0:1788620158.837452:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061766528:12345-0@lo:400: Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620158.837460:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788620158.837483:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620158.837573:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620158.837636:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766400 00000100:00100000:1.0:1788620158.837641:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766400 00000100:00100000:1.0:1788620158.837676:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620158.837684:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061766400:12345-0@lo:400: 00000100:00100000:1.0:1788620158.837722:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061766400:12345-0@lo:400: Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620158.837744:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788620158.837779:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a30700 x1875504061766400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620158.837791:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061766400:0@lo:400: 00000100:00100000:3.0:1788620158.837934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766016 00000100:00100000:3.0:1788620158.837939:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766016 00000100:00100000:3.0:1788620158.837974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788620158.837982:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061766016:12345-0@lo:400: 00000100:00100000:3.0:1788620158.838019:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061766016:12345-0@lo:400: Request processed in 38us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620158.838036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788620158.838073:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620158.838472:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061766528:0@lo:400: 00000100:00100000:2.0:1788620158.838491:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061766016:0@lo:400: 00000100:00100000:0.0:1788620158.838661:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620158.838707:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061766656:0@lo:400: 00000100:00100000:0.0:1788620158.838734:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620158.839052:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766656 00000100:00100000:2.0:1788620158.839068:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766656 00000100:00100000:2.0:1788620158.839108:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620158.839115:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061766656:12345-0@lo:400: 00000100:00100000:2.0:1788620158.839163:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061766656:12345-0@lo:400: Request processed in 49us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620158.839170:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620158.839281:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766144 00000100:00100000:3.0:1788620158.839285:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766144 00000100:00100000:3.0:1788620158.839320:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788620158.839326:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061766144:12345-0@lo:400: 00000100:00100000:3.0:1788620158.839358:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061766144:12345-0@lo:400: Request processed in 33us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620158.839363:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788620158.839626:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061766144:0@lo:400: 00010000:00080000:0.0:1788620158.839640:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a33800 x1875504061766656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620158.839649:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061766656:0@lo:400: 00010000:00010000:2.0:1788620159.273302:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620159.336657:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061766912:0@lo:13: 00000100:00100000:1.0:1788620159.336732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620159.336943:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061766912 00000100:00100000:3.0:1788620159.336951:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061766912 00000100:00100000:3.0:1788620159.336999:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788620159.337008:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061766912:12345-0@lo:13: 00002000:00000024:3.0:1788620159.337038:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620159.337109:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061766912:12345-0@lo:13: Request processed in 101us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620159.337116:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788620159.337202:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a31500 x1875504061766912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620159.337220:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061766912:0@lo:13: 00010000:00010000:3.0:1788620160.296378:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620160.556193:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620160.556836:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969088 00000100:00100000:2.0:1788620160.556848:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969088 00000100:00100000:2.0:1788620160.556936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:2.0:1788620160.556948:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:5670:x1875504044969088:12345-192.168.201.11@tcp:41: 00000004:00000024:2.0:1788620160.557009:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788620160.557090:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:5670:x1875504044969088:12345-192.168.201.11@tcp:41: Request processed in 144us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.557097:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00080000:1.0:1788620160.557370:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620160.570822:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620160.570891:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969216 00000100:00100000:3.0:1788620160.570902:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969216 00000100:00100000:3.0:1788620160.571158:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:3.0:1788620160.571170:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5670:x1875504044969216:12345-192.168.201.11@tcp:13: 00002000:00000024:3.0:1788620160.571210:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620160.571385:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5670:x1875504044969216:12345-192.168.201.11@tcp:13: Request processed in 216us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620160.571393:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00080000:1.0:1788620160.571769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620160.574427:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620160.575302:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969344 00000100:00100000:0.0:1788620160.575315:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969344 00000100:00080000:1.0:1788620160.575392:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620160.575419:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620160.575431:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5670:x1875504044969344:12345-192.168.201.11@tcp:13: 00002000:00000024:0.0:1788620160.575474:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620160.575546:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:5670:x1875504044969344:12345-192.168.201.11@tcp:13: Request processed in 118us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620160.575555:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00010000:00010000:2.0:1788620161.322884:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788620161.971593:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00010000:00010000:3.0:1788620162.344466:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788620162.462194:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000001:00100000:1.0:1788620162.481128:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00010000:00010000:2.0:1788620163.371139:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620163.408457:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620163.408505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620163.408536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620163.408570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620163.408609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969600 00000100:00100000:2.0:1788620163.408619:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969600 00000100:00100000:2.0:1788620163.408681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:2.0:1788620163.408691:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044969600:12345-192.168.201.11@tcp:400: 00000100:00100000:2.0:1788620163.408779:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044969600:12345-192.168.201.11@tcp:400: Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620163.408804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:2.0:1788620163.408846:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969728 00000100:00100000:2.0:1788620163.408850:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969728 00000100:00100000:2.0:1788620163.408875:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969856 00000100:00100000:2.0:1788620163.408878:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969856 00000100:00100000:2.0:1788620163.408902:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:2.0:1788620163.408909:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044969728:12345-192.168.201.11@tcp:400: 00000100:00100000:2.0:1788620163.408936:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044969728:12345-192.168.201.11@tcp:400: Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620163.408953:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:2.0:1788620163.408968:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:2.0:1788620163.408974:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044969856:12345-192.168.201.11@tcp:400: 00000100:00100000:3.0:1788620163.409287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969472 00000100:00100000:3.0:1788620163.409292:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969472 00000100:00100000:3.0:1788620163.409326:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 126 00000100:00100000:3.0:1788620163.409334:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2353:x1875504044969472:12345-192.168.201.11@tcp:400: 00000100:00100000:3.0:1788620163.409361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2353:x1875504044969472:12345-192.168.201.11@tcp:400: Request processed in 29us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620163.409368:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 126 00000100:00100000:2.0:1788620163.409908:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044969856:12345-192.168.201.11@tcp:400: Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620163.409918:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00080000:2.0:1788620163.409959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620163.409963:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620163.409965:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788620163.533000:0:8295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788620163.944460:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788620163.944489:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061767040:0@lo:13: 00000100:00100000:0.0:1788620163.944569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620163.944824:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061767040 00000100:00100000:3.0:1788620163.944833:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061767040 00000100:00100000:3.0:1788620163.944945:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620163.944954:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061767040:12345-0@lo:13: 00002000:00000024:3.0:1788620163.944988:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620163.945035:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061767040:12345-0@lo:13: Request processed in 82us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620163.945054:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788620163.945096:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d664e08e00 x1875504061767040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620163.945125:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061767040:0@lo:13: 00000100:00080000:0.0:1788620163.948034:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620163.953026:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061767296:0@lo:400: 00000100:00100000:0.0:1788620163.953098:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620163.953158:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788620163.953164:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061767168:0@lo:400: 00000100:00100000:0.0:1788620163.953192:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620163.953219:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061767680:0@lo:400: 00000100:00100000:0.0:1788620163.953239:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620163.953399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061767168 00000100:00100000:1.0:1788620163.953407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061767168 00000100:00100000:1.0:1788620163.953455:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788620163.953466:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061767168:12345-0@lo:400: 00000100:00100000:3.0:1788620163.953990:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061767296 00000100:00100000:3.0:1788620163.953995:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061767296 00000100:00100000:3.0:1788620163.954024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061767680 00000100:00100000:3.0:1788620163.954026:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061767680 00000100:00100000:3.0:1788620163.954052:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788620163.954058:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061767296:12345-0@lo:400: 00000100:00100000:3.0:1788620163.954886:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061767296:12345-0@lo:400: Request processed in 826us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620163.954895:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788620163.954919:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620163.954927:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061767680:12345-0@lo:400: 00000100:00100000:1.0:1788620163.961124:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061767168:12345-0@lo:400: Request processed in 7642us (7912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620163.961138:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788620163.961209:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061767552:0@lo:400: 00000100:00100000:1.0:1788620163.961267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788620163.961309:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620163.961312:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620163.961319:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061767424:0@lo:400: 00000100:00100000:2.0:1788620163.961357:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061767168:0@lo:400: 00000100:00100000:2.0:1788620163.969318:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061767296:0@lo:400: 00000100:00100000:1.0:1788620163.970359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620163.970459:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061767552 00000100:00100000:1.0:1788620163.970466:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061767552 00000100:00100000:1.0:1788620163.970549:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620163.970558:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061767552:12345-0@lo:400: 00000100:00100000:1.0:1788620163.970626:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061767552:12345-0@lo:400: Request processed in 69us (9375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620163.970633:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788620163.970651:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788620163.970673:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a31880 x1875504061767552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620163.970685:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061767552:0@lo:400: 00000100:00100000:3.0:1788620163.974785:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061767680:12345-0@lo:400: Request processed in 19784us (21468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620163.974802:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620163.974857:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061767424 00000100:00100000:3.0:1788620163.974918:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061767424 00000100:00080000:3.0:1788620163.974989:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620163.975105:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061767680:0@lo:400: 00000100:00100000:0.0:1788620163.976815:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620163.976838:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061767424:12345-0@lo:400: 00000100:00100000:0.0:1788620163.976968:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061767424:12345-0@lo:400: Request processed in 141us (6613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620163.976976:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788620163.981178:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061767424:0@lo:400: 00010000:00010000:3.0:1788620164.395139:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620164.456733:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620164.456763:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061767808:0@lo:13: 00000100:00100000:2.0:1788620164.456855:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620164.456962:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061767808 00000100:00100000:2.0:1788620164.456970:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061767808 00000100:00100000:2.0:1788620164.457019:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620164.457030:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061767808:12345-0@lo:13: 00002000:00000024:2.0:1788620164.457065:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620164.457109:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061767808:12345-0@lo:13: Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620164.457117:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788620164.457165:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a31c00 x1875504061767808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620164.457183:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061767808:0@lo:13: 00010000:00010000:2.0:1788620165.416449:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620166.440440:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788620167.000775:0:8443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd903d67a0 20000000:00000080:1.0:1788620167.000875:0:8443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0d675cbc800 uarg=0000000000000000 20000000:01000000:1.0:1788620167.000923:0:8443:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788620167.000926:0:8443:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788620167.000929:0:8443:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788620167.000934:0:8443:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788620167.000940:0:8443:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788620167.000955:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788620167.000957:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788620167.001692:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788620167.001695:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788620167.002769:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788620167.003646:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788620167.003724:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788620167.003764:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788620167.003866:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788620167.003870:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788620167.004987:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788620167.005942:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788620167.006002:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788620167.006054:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788620167.006071:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788620167.006074:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788620167.007398:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788620167.007983:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788620167.008048:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788620167.008084:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788620167.008100:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788620167.008102:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788620167.011218:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788620167.011926:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788620167.011995:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788620167.012028:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1788620167.012044:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788620167.012064:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012083:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0386 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012092:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03b0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012098:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03da expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012104:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03e8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012110:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03f6 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012128:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012135:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd043c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012156:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012163:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012170:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012208:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012223:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 9 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.012237:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061767936:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620167.012375:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012384:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 9 pid: 5832 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.012392:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768064:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620167.012424:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd043c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012431:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd043c expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.012452:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768192:0@lo:104: 00000100:00100000:0.0:1788620167.012502:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788620167.012543:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012551:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.012560:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768320:0@lo:104: 00000100:00100000:0.0:1788620167.012583:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620167.012621:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788620167.012636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061768192 00000100:00100000:0.0:1788620167.012644:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061768192 00000100:00100000:0.0:1788620167.012678:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061768320 00000100:00100000:0.0:1788620167.012681:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061768320 00000100:00100000:0.0:1788620167.012694:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788620167.012702:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8443:x1875504061768192:12345-0@lo:104: 00010000:00010000:0.0:1788620167.012713:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012757:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620167.012764:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8443:x1875504061768192:12345-0@lo:104: Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.012770:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788620167.012787:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788620167.012792:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f749450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8443:x1875504061768320:12345-0@lo:104: 00010000:00010000:0.0:1788620167.012799:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012839:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788620167.012845:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f749450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8443:x1875504061768320:12345-0@lo:104: Request processed in 53us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.012850:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788620167.012895:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620167.012900:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012907:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925800 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620167.012910:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.012918:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620167.012925:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620167.012929:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620167.013004:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620167.013140:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620167.013146:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.013153:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510800 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620167.013156:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.013164:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620167.013183:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620167.013188:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788620167.014234:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.014245:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620167.014375:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.014383:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925800/0x24857de440bd043c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.014411:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620167.014413:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620167.014415:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620167.014432:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061768448:0@lo:103: 00000100:00100000:0.0:1788620167.014484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620167.014544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061768448 00000100:00100000:0.0:1788620167.014552:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061768448 00010000:00010000:0.0:1788620167.014579:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd043c expref: 19 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.014606:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788620167.014615:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061768448:12345-0@lo:103: 00010000:00010000:0.0:1788620167.014627:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620167.014632:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd043c expref: 19 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.014642:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd043c expref: 19 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.014660:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620167.014692:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061768448:12345-0@lo:103: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.014699:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788620167.014733:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061768448:0@lo:103: 00010000:00010000:0.0:1788620167.014905:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd03f6 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.014928:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd03f6 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.014938:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768576:0@lo:104: 00000100:00100000:0.0:1788620167.014962:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788620167.014996:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd03e8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.015005:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd03e8 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.015013:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768704:0@lo:104: 00000100:00100000:0.0:1788620167.015032:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788620167.015057:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd03da expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.015064:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd03da expref: 18 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.015072:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768832:0@lo:104: 00000100:00100000:0.0:1788620167.015091:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788620167.015106:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd03b0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620167.015203:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061768576 00000100:00100000:1.0:1788620167.015208:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061768576 00000100:00100000:1.0:1788620167.015228:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061768704 00000100:00100000:1.0:1788620167.015230:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061768704 00000100:00100000:1.0:1788620167.015237:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061768832 00000100:00100000:1.0:1788620167.015239:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061768832 00000100:00100000:1.0:1788620167.015280:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620167.015287:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+5:8443:x1875504061768576:12345-0@lo:104: 00010000:00010000:1.0:1788620167.015302:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.015343:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620167.015348:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+5:8443:x1875504061768576:12345-0@lo:104: Request processed in 62us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620167.015354:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620167.015366:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620167.015371:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8443:x1875504061768704:12345-0@lo:104: 00010000:00010000:1.0:1788620167.015378:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.015402:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788620167.015407:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8443:x1875504061768704:12345-0@lo:104: Request processed in 36us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620167.015412:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620167.015422:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788620167.015427:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8443:x1875504061768832:12345-0@lo:104: 00010000:00010000:1.0:1788620167.015433:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.015457:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788620167.015462:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8443:x1875504061768832:12345-0@lo:104: Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620167.015467:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788620167.015481:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788620167.015486:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.015498:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549800 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620167.015502:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.015510:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620167.015517:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620167.015522:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788620167.015564:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd03b0 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.015574:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768960:0@lo:104: 00000100:00100000:0.0:1788620167.015601:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788620167.015625:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0386 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.015632:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0386 expref: 18 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.015640:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061769088:0@lo:104: 00000100:00100000:0.0:1788620167.015656:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620167.015664:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b900 going to sleep for 11 seconds 00010000:00010000:0.0:1788620167.015677:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641510000/0x24857de440bd0443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd043c expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.015694:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768192:0@lo:104: 00000100:00100000:0.0:1788620167.015702:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768320:0@lo:104: 00000100:00100000:0.0:1788620167.015707:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768576:0@lo:104: 00000100:00100000:0.0:1788620167.015713:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768704:0@lo:104: 00000100:00100000:0.0:1788620167.015719:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768832:0@lo:104: 00010000:00010000:2.0:1788620167.015845:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015853:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620167.015875:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015896:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641510800/0x24857de440bd0412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0419 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015909:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620167.015912:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015917:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511600 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620167.015920:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015926:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620167.015932:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620167.015937:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620167.015961:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015966:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620167.015981:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015987:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641511600/0x24857de440bd03e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03ef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.015999:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620167.016002:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016007:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549a00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620167.016010:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016016:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620167.016022:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620167.016027:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620167.016039:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016045:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620167.016050:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016066:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c549a00/0x24857de440bd03da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03e1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016075:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620167.016077:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620167.016078:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620167.016095:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061768960 00000100:00100000:2.0:1788620167.016100:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061768960 00000100:00100000:2.0:1788620167.016132:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769088 00000100:00100000:2.0:1788620167.016134:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769088 00000100:00100000:2.0:1788620167.016146:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620167.016151:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8443:x1875504061768960:12345-0@lo:104: 00010000:00010000:2.0:1788620167.016159:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016199:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620167.016204:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8443:x1875504061768960:12345-0@lo:104: Request processed in 53us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620167.016210:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620167.016224:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620167.016230:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8443:x1875504061769088:12345-0@lo:104: 00010000:00010000:2.0:1788620167.016237:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016296:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788620167.016301:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8443:x1875504061769088:12345-0@lo:104: Request processed in 72us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620167.016315:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620167.016335:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061769344:0@lo:103: 00000100:00100000:2.0:1788620167.016361:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620167.016389:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620167.016394:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061769472:0@lo:103: 00000100:00100000:2.0:1788620167.016412:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788620167.016446:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620167.016451:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016457:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925c00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620167.016461:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016467:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620167.016473:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620167.016478:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620167.016493:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016499:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620167.016504:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016510:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925c00/0x24857de440bd03b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03b7 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016530:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620167.016532:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016537:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924e00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620167.016540:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016545:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620167.016550:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620167.016555:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620167.016569:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016575:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620167.016579:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016584:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680924e00/0x24857de440bd0386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd038d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.016593:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620167.016594:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620167.016596:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620167.016602:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620167.016610:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620167.016816:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061769216:0@lo:103: 00000100:00100000:0.0:1788620167.016841:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620167.016868:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061769728:0@lo:103: 00000100:00100000:0.0:1788620167.016897:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620167.016909:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620167.016913:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061769600:0@lo:103: 00000100:00100000:0.0:1788620167.016932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620167.016952:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769344 00000100:00100000:0.0:1788620167.016956:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769344 00010000:00010000:0.0:1788620167.016980:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03e8 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.016994:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769472 00000100:00100000:0.0:1788620167.016996:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769472 00010000:00010000:0.0:1788620167.017006:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03da expref: 19 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.017014:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769216 00000100:00100000:0.0:1788620167.017016:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769216 00010000:00010000:0.0:1788620167.017023:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0412 expref: 20 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.017031:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769728 00000100:00100000:0.0:1788620167.017033:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769728 00010000:00010000:0.0:1788620167.017041:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0386 expref: 21 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.017050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769600 00000100:00100000:0.0:1788620167.017052:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769600 00010000:00010000:0.0:1788620167.017060:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03b0 expref: 22 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.017071:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788620167.017076:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+22:3310:x1875504061769344:12345-0@lo:103: 00010000:00010000:0.0:1788620167.017085:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620167.017089:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03e8 expref: 22 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017097:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd03e8 expref: 22 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017225:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641510400/0x24857de440bd03ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd03e8 expref: 22 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017242:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620167.017300:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+21:3310:x1875504061769344:12345-0@lo:103: Request processed in 223us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.017307:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788620167.017322:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788620167.017328:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+20:3310:x1875504061769472:12345-0@lo:103: 00010000:00010000:0.0:1788620167.017335:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620167.017339:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03da expref: 20 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017347:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd03da expref: 20 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017358:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924c00/0x24857de440bd03e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd03da expref: 20 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017366:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620167.017385:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061769472:12345-0@lo:103: Request processed in 57us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.017391:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788620167.017401:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788620167.017406:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:3309:x1875504061769216:12345-0@lo:103: 00010000:00010000:0.0:1788620167.017412:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620167.017416:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017429:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017439:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640031e00/0x24857de440bd0419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0412 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017448:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620167.017473:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3309:x1875504061769216:12345-0@lo:103: Request processed in 68us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.017479:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788620167.017491:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788620167.017497:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3309:x1875504061769728:12345-0@lo:103: 00010000:00010000:0.0:1788620167.017504:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620167.017509:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0386 expref: 16 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017516:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0386 expref: 16 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017526:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620167.017546:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3309:x1875504061769728:12345-0@lo:103: Request processed in 49us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.017551:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788620167.017562:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788620167.017567:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:3309:x1875504061769600:12345-0@lo:103: 00010000:00010000:0.0:1788620167.017574:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620167.017578:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03b0 expref: 15 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017591:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd03b0 expref: 15 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.017600:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620167.017618:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:3309:x1875504061769600:12345-0@lo:103: Request processed in 51us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.017623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788620167.017652:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061769472:0@lo:103: 00000100:00100000:0.0:1788620167.017660:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061769344:0@lo:103: 00000100:00100000:0.0:1788620167.017682:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061769600:0@lo:103: 00000100:00100000:0.0:1788620167.017690:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061769216:0@lo:103: 00000100:00100000:0.0:1788620167.017696:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061769728:0@lo:103: 00010000:00010000:0.0:1788620167.017727:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924a00/0x24857de440bd03b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd03b0 expref: 14 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.017735:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768960:0@lo:104: 00010000:00010000:0.0:1788620167.017744:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640030c00/0x24857de440bd038d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0386 expref: 13 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.017753:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061769088:0@lo:104: 00000100:00100000:2.0:1788620167.023054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620167.023141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620167.023167:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044969984 00000100:00100000:2.0:1788620167.023176:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044969984 00010000:00010000:2.0:1788620167.023214:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 10 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620167.023239:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044970112 00000100:00100000:2.0:1788620167.023242:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044970112 00010000:00010000:2.0:1788620167.023284:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 11 pid: 5832 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620167.023300:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:2.0:1788620167.023309:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:2355:x1875504044969984:12345-192.168.201.11@tcp:103: 00010000:00010000:2.0:1788620167.023321:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620167.023327:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 11 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.023340:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 11 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.023360:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620167.023400:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:2355:x1875504044969984:12345-192.168.201.11@tcp:103: Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620167.023408:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:2.0:1788620167.023444:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:2.0:1788620167.023450:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2355:x1875504044970112:12345-192.168.201.11@tcp:103: 00010000:00010000:2.0:1788620167.023457:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620167.023474:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 10 pid: 5832 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.023484:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 10 pid: 5832 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620167.023493:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620167.023513:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2355:x1875504044970112:12345-192.168.201.11@tcp:103: Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620167.023519:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00010000:00010000:0.0:1788620167.024242:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c549e00/0x24857de440bd0458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b218a expref: 9 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.024286:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061767936:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620167.024315:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c548c00/0x24857de440bd0451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2183 expref: 8 pid: 5832 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620167.024324:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1875504061768064:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620167.024372:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.031746:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.031763:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620167.031875:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.031898:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c549800/0x24857de440bd03f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620167.031926:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620167.031950:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061769856:0@lo:103: 00000100:00100000:1.0:1788620167.032280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620167.033550:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769856 00000100:00100000:1.0:1788620167.033561:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769856 00010000:00010000:1.0:1788620167.033602:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03f6 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620167.033658:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620167.033668:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:3311:x1875504061769856:12345-0@lo:103: 00010000:00010000:1.0:1788620167.033683:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620167.033688:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03f6 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033699:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd03f6 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033716:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641511200/0x24857de440bd03fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd03f6 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033735:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033743:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033758:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033764:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033770:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033775:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033792:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620167.033797:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033804:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033817:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620167.033828:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620167.034438:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+12:3311:x1875504061769856:12345-0@lo:103: Request processed in 213us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620167.034449:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620167.034503:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061769856:0@lo:103: 00010000:00010000:1.0:1788620167.034545:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620167.034548:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620167.034550:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620167.034701:0:8443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.034711:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.034718:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0490 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620167.264809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620167.266889:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044970240 00000100:00100000:0.0:1788620167.266904:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044970240 00000100:00100000:0.0:1788620167.266977:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 128 00000100:00100000:0.0:1788620167.266988:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:5593:x1875504044970240:12345-192.168.201.11@tcp:101: 00010000:00010000:0.0:1788620167.267007:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620167.267030:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b21ec expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.267057:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21ec expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.267069:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21ec expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.267091:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519e00, rc 0) 00000100:00100000:0.0:1788620167.267164:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5593:x1875504044970240:12345-192.168.201.11@tcp:101: Request processed in 177us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.267172:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 128 00000100:00100000:2.0:1788620167.269495:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620167.269578:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044970368 00000100:00100000:0.0:1788620167.269587:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044970368 00000100:00100000:0.0:1788620167.269637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 129 00000100:00100000:0.0:1788620167.269645:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5593:x1875504044970368:12345-192.168.201.11@tcp:501: 00000100:00100000:0.0:1788620167.269963:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5593:x1875504044970368:12345-192.168.201.11@tcp:501: Request processed in 317us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.269971:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 129 00000100:00100000:3.0:1788620167.271574:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620167.274590:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044970496 00000100:00100000:0.0:1788620167.274605:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044970496 00000100:00100000:0.0:1788620167.274658:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 130 00000100:00100000:0.0:1788620167.274667:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5593:x1875504044970496:12345-192.168.201.11@tcp:503: 00000100:00100000:0.0:1788620167.275298:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5593:x1875504044970496:12345-192.168.201.11@tcp:503: Request processed in 629us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.275306:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 130 00000100:00100000:3.0:1788620167.278266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620167.278732:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044970624 00000100:00100000:2.0:1788620167.278741:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044970624 00000100:00100000:2.0:1788620167.278836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 131 00000100:00100000:2.0:1788620167.278846:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:6058:x1875504044970624:12345-192.168.201.11@tcp:502: 00000100:00100000:2.0:1788620167.279205:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:6058:x1875504044970624:12345-192.168.201.11@tcp:502: Request processed in 359us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620167.279214:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 131 00000100:00100000:1.0:1788620167.281495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620167.281788:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044970752 00000100:00100000:0.0:1788620167.281798:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044970752 00000100:00100000:2.0:1788620167.281865:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 132 00000100:00100000:2.0:1788620167.281888:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:6058:x1875504044970752:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788620167.282294:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:6058:x1875504044970752:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 419us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620167.282303:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 132 00000100:00100000:2.0:1788620167.285004:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620167.285053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044970880 00000100:00100000:0.0:1788620167.285063:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044970880 00000100:00100000:0.0:1788620167.285109:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 133 00000100:00100000:0.0:1788620167.285119:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5593:x1875504044970880:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620167.285135:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620167.285165:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a518c00/0x24857de440bd049e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b21f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.285193:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a518c00/0x24857de440bd049e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21f3 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.285203:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a518c00/0x24857de440bd049e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21f3 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620167.285213:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518c00, rc 0) 00000100:00100000:0.0:1788620167.285429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044970880:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 173us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620167.285437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 133 00000100:00100000:1.0:1788620167.286826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620167.286909:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971008 00000100:00100000:3.0:1788620167.286917:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971008 00000100:00100000:3.0:1788620167.286978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 134 00000100:00100000:3.0:1788620167.286987:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044971008:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620167.287223:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044971008:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 236us (398us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620167.287231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 134 00010000:00010000:2.0:1788620167.464430:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620168.491952:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620168.519438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620168.519483:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620168.519516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620168.519545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620168.519578:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971136 00000100:00100000:0.0:1788620168.519588:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971136 00000100:00100000:0.0:1788620168.519650:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 135 00000100:00100000:0.0:1788620168.519661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2354:x1875504044971136:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620168.519728:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2354:x1875504044971136:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.519735:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 135 00000100:00100000:0.0:1788620168.519783:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971520 00000100:00100000:0.0:1788620168.519786:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971520 00000100:00100000:0.0:1788620168.519817:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971392 00000100:00100000:0.0:1788620168.519820:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971392 00000100:00100000:0.0:1788620168.519871:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620168.519879:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504044971520:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620168.519907:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504044971520:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.519914:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620168.519927:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620168.519933:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504044971392:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620168.519955:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504044971392:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.519961:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00080000:3.0:1788620168.520172:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620168.520176:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620168.520278:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971264 00000100:00100000:1.0:1788620168.520283:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971264 00000100:00100000:1.0:1788620168.520319:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:1.0:1788620168.520328:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504044971264:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620168.520359:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504044971264:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 34us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620168.520376:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00080000:0.0:1788620168.522456:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1788620168.680459:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788620168.680468:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d675d13000 from 39 10000000:01000000:3.0:1788620168.680474:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788620168.680518:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.680530:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.680542:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.680566:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061769984:0@lo:101: 00000100:00100000:3.0:1788620168.680626:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.680722:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620168.680832:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061769984 00000100:00100000:1.0:1788620168.680840:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061769984 00000100:00100000:1.0:1788620168.682806:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788620168.682829:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+12:5836:x1875504061769984:12345-0@lo:101: 00010000:00010000:1.0:1788620168.682846:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620168.682873:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c548a00/0x24857de440bd04ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd04a5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.682904:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c548a00/0x24857de440bd04ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd04a5 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.683356:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c548a00/0x24857de440bd04ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd04a5 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.683368:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548a00, rc 0) 00000100:00100000:1.0:1788620168.683879:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061769984:12345-0@lo:101: Request processed in 1059us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620168.683887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788620168.688727:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061769984:0@lo:101: 00010000:00010000:3.0:1788620168.688755:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.688768:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620168.691495:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770112:0@lo:501: 00000100:00100000:2.0:1788620168.691583:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620168.691627:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.691858:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061770112 00000100:00100000:0.0:1788620168.691866:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061770112 00000100:00100000:0.0:1788620168.691929:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788620168.691940:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061770112:12345-0@lo:501: 00000100:00100000:0.0:1788620168.693445:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061770112:12345-0@lo:501: Request processed in 1500us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.693456:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788620168.693928:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770112:0@lo:501: 00000100:00100000:2.0:1788620168.693979:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770240:0@lo:503: 00000100:00100000:2.0:1788620168.694234:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620168.694295:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.695778:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061770240 00000100:00100000:3.0:1788620168.695789:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061770240 00000100:00100000:3.0:1788620168.695839:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788620168.695849:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061770240:12345-0@lo:503: 00000100:00100000:3.0:1788620168.696337:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061770240:12345-0@lo:503: Request processed in 489us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.696346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788620168.696401:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770240:0@lo:503: 00000100:00100000:3.0:1788620168.696587:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8467:1875504061770368:0@lo:502: 00000100:00100000:3.0:1788620168.696627:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.697423:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620168.702944:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061770368 00000100:00100000:2.0:1788620168.702960:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061770368 00000100:00100000:2.0:1788620168.703038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788620168.703049:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:8467:x1875504061770368:12345-0@lo:502: 00000100:00100000:2.0:1788620168.703363:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:8467:x1875504061770368:12345-0@lo:502: Request processed in 316us (6734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620168.703371:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788620168.704451:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8467:1875504061770368:0@lo:502: 00000100:00100000:3.0:1788620168.704520:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8467:1875504061770496:0@lo:502: 00000100:00100000:3.0:1788620168.704572:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.704610:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.704731:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061770496 00000100:00100000:0.0:1788620168.704738:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061770496 00000100:00100000:0.0:1788620168.704846:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788620168.704864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:8467:x1875504061770496:12345-0@lo:502: 00000100:00100000:0.0:1788620168.705479:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+13:8467:x1875504061770496:12345-0@lo:502: Request processed in 615us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.705488:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788620168.705591:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8467:1875504061770496:0@lo:502: 00000040:00080000:2.0:1788620168.705618:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788620168.707401:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788620168.707439:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788620168.707451:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.707462:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620168.707473:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788620168.707476:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788620168.707478:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788620168.707512:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.707520:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.707530:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620168.707553:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770624:0@lo:101: 00000100:00100000:0.0:1788620168.707615:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.707668:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620168.707836:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061770624 00000100:00100000:2.0:1788620168.707844:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061770624 00000100:00100000:2.0:1788620168.707906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788620168.707926:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+13:5836:x1875504061770624:12345-0@lo:101: 00010000:00010000:2.0:1788620168.707939:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620168.707953:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3600/0x24857de440bd04ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd04b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.707976:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3600/0x24857de440bd04ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd04b3 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.707986:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe3600/0x24857de440bd04ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd04b3 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.708169:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3600, rc 0) 00000100:00100000:2.0:1788620168.708213:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061770624:12345-0@lo:101: Request processed in 298us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620168.708220:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788620168.708323:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770624:0@lo:101: 00010000:00010000:0.0:1788620168.708337:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.708346:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620168.708394:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770752:0@lo:501: 00000100:00100000:0.0:1788620168.708427:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.708459:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620168.708567:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061770752 00000100:00100000:2.0:1788620168.708572:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061770752 00000100:00100000:2.0:1788620168.708603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788620168.708609:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061770752:12345-0@lo:501: 00000100:00100000:2.0:1788620168.709213:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061770752:12345-0@lo:501: Request processed in 601us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620168.709220:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788620168.709343:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770752:0@lo:501: 00000100:00100000:0.0:1788620168.709374:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770880:0@lo:503: 00000100:00100000:0.0:1788620168.709413:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.709445:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.709459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061770880 00000100:00100000:0.0:1788620168.709463:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061770880 00000100:00100000:0.0:1788620168.709490:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788620168.709498:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061770880:12345-0@lo:503: 00000100:00100000:0.0:1788620168.709758:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061770880:12345-0@lo:503: Request processed in 260us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.709764:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788620168.709883:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061770880:0@lo:503: 00000100:00100000:0.0:1788620168.711197:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8469:1875504061771008:0@lo:502: 00000100:00100000:0.0:1788620168.711418:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.711482:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620168.711524:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771008 00000100:00100000:2.0:1788620168.711532:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771008 00000100:00100000:2.0:1788620168.711608:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788620168.711618:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:8469:x1875504061771008:12345-0@lo:502: 00000100:00100000:2.0:1788620168.711861:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:8469:x1875504061771008:12345-0@lo:502: Request processed in 234us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620168.711869:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788620168.711949:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8469:1875504061771008:0@lo:502: 00000020:01000000:3.0:1788620168.711978:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620168.711987:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620168.711989:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788620168.711996:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788620168.712038:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8469:1875504061771136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.712074:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.712569:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.712604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771136 00000100:00100000:0.0:1788620168.712610:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771136 00000100:00100000:0.0:1788620168.712696:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788620168.712704:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:8469:x1875504061771136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620168.713550:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:8469:x1875504061771136:12345-0@lo:502:llog_process_th.0 Request processed in 843us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.713559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788620168.719405:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8469:1875504061771136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620168.719465:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620168.719474:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620168.719476:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620168.719481:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788620168.724496:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788620168.724531:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788620168.724545:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.724558:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620168.724586:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788620168.724589:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d680c0a000 from 39 10000000:01000000:2.0:1788620168.724592:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788620168.724631:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.724650:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.724660:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620168.724685:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.724754:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620168.726732:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.729810:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771264 00000100:00100000:0.0:1788620168.729840:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771264 00000100:00100000:0.0:1788620168.733784:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788620168.733800:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:5836:x1875504061771264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620168.733817:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620168.733837:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a518600/0x24857de440bd04c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd04c1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.733879:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a518600/0x24857de440bd04c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd04c1 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.733889:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a518600/0x24857de440bd04c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd04c1 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.733899:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518600, rc 0) 00000100:00100000:0.0:1788620168.736607:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061771264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2803us (11845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.736622:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788620168.738873:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620168.738903:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.739765:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620168.739866:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.743575:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.743884:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771392 00000100:00100000:0.0:1788620168.743894:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771392 00000100:00100000:2.0:1788620168.744345:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.744727:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788620168.744742:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061771392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620168.745376:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061771392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 638us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.745386:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788620168.746262:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.746320:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.746382:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620168.754638:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.760814:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771520 00000100:00100000:3.0:1788620168.760829:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771520 00000100:00100000:3.0:1788620168.761274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788620168.761287:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061771520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.762573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061771520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1283us (16184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.762584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788620168.767228:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620168.777506:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8471:1875504061771648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620168.777589:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620168.777630:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.777693:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771648 00000100:00100000:3.0:1788620168.777701:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771648 00000100:00100000:3.0:1788620168.777746:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788620168.777755:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:8471:x1875504061771648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.779385:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:8471:x1875504061771648:12345-0@lo:502:llog_process_th.0 Request processed in 1623us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.779399:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788620168.781738:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8471:1875504061771648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620168.781842:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8471:1875504061771776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620168.781929:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620168.781977:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.782180:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771776 00000100:00100000:3.0:1788620168.782187:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771776 00000100:00100000:3.0:1788620168.782268:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788620168.782277:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:8471:x1875504061771776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.782521:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+15:8471:x1875504061771776:12345-0@lo:502:llog_process_th.0 Request processed in 245us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.782529:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788620168.783439:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8471:1875504061771776:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788620168.783472:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788620168.785915:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788620168.785949:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788620168.785971:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.785985:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620168.785996:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788620168.785999:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788620168.786002:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788620168.787016:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.787289:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.787301:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.787343:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.787407:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.787450:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788620168.788927:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061771904 00000100:00100000:2.0:1788620168.788943:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061771904 00000100:00100000:2.0:1788620168.789008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788620168.789019:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:5836:x1875504061771904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620168.789036:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620168.789055:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2800/0x24857de440bd04d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd04cf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.789087:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2800/0x24857de440bd04d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd04cf expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.789099:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2800/0x24857de440bd04d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd04cf expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.789109:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2800, rc 0) 00000100:00100000:2.0:1788620168.789192:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061771904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620168.789200:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788620168.789331:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061771904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620168.789349:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.789360:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620168.789427:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620168.789461:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620168.789495:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.789884:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772032 00000100:00100000:3.0:1788620168.789891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772032 00000100:00100000:3.0:1788620168.789932:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788620168.789940:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061772032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620168.815626:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061772032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 25676us (26154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.815642:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788620168.815663:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.815734:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.815797:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620168.815860:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65042fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.816156:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772160 00000100:00100000:0.0:1788620168.816171:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772160 00000100:00100000:0.0:1788620168.816239:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788620168.816270:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061772160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620168.816527:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061772160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.816535:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788620168.816585:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620168.817970:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8474:1875504061772288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620168.818066:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.818103:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.818507:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772288 00000100:00100000:3.0:1788620168.818515:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772288 00000100:00100000:3.0:1788620168.818587:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788620168.818605:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:8474:x1875504061772288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.819112:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:8474:x1875504061772288:12345-0@lo:502:llog_process_th.0 Request processed in 509us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.819120:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788620168.819633:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8474:1875504061772288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788620168.819678:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620168.819688:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620168.819691:0:8474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788620168.819701:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788620168.819730:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8474:1875504061772416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620168.819843:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.819919:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.819954:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772416 00000100:00100000:3.0:1788620168.819960:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772416 00000100:00100000:3.0:1788620168.820138:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788620168.820147:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:8474:x1875504061772416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.820360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:8474:x1875504061772416:12345-0@lo:502:llog_process_th.0 Request processed in 214us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.820368:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788620168.820462:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8474:1875504061772416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788620168.820482:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620168.820489:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620168.820491:0:8474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788620168.820496:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788620168.820830:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788620168.820871:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788620168.820882:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.820893:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620168.820903:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788620168.820906:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d649f43000 from 39 10000000:01000000:3.0:1788620168.820909:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788620168.820935:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.820942:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.820951:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.820974:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.821141:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.821213:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.821582:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772544 00000100:00100000:0.0:1788620168.821589:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772544 00000100:00100000:1.0:1788620168.821722:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788620168.821731:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061772544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620168.821743:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620168.821755:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c548200/0x24857de440bd04e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd04dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.821788:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c548200/0x24857de440bd04e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd04dd expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.821806:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c548200/0x24857de440bd04e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd04dd expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.821814:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548200, rc 0) 00000100:00100000:1.0:1788620168.821868:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061772544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620168.821876:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788620168.821943:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620168.821957:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.821966:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.822043:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.822074:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.822507:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772672 00000100:00100000:0.0:1788620168.822513:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772672 00000100:00100000:0.0:1788620168.822547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788620168.822555:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061772672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.822637:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620168.822883:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061772672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620168.822903:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788620168.823169:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.823212:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620168.824416:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.824531:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772800 00000100:00100000:2.0:1788620168.824536:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65042fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.824540:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772800 00000100:00100000:3.0:1788620168.824601:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788620168.824617:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061772800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.829162:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061772800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4536us (4739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.829177:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788620168.830634:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061772800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620168.835898:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8476:1875504061772928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620168.835985:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620168.836131:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.838218:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061772928 00000100:00100000:3.0:1788620168.838230:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061772928 00000100:00100000:3.0:1788620168.839562:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788620168.839578:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8476:x1875504061772928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.839882:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8476:x1875504061772928:12345-0@lo:502:llog_process_th.0 Request processed in 308us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.839899:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788620168.843884:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8476:1875504061772928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620168.843963:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8476:1875504061773056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620168.844139:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620168.844186:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.844239:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773056 00000100:00100000:3.0:1788620168.844246:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773056 00000100:00100000:3.0:1788620168.844319:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788620168.844329:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8476:x1875504061773056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.844570:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8476:x1875504061773056:12345-0@lo:502:llog_process_th.0 Request processed in 241us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.844578:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788620168.845142:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8476:1875504061773056:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788620168.845167:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788620168.845390:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788620168.845412:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788620168.845423:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.845434:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620168.845444:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788620168.845447:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788620168.845450:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788620168.845477:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.845485:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.845494:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620168.845511:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788620168.845551:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620168.845590:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ceab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620168.845962:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773184 00000100:00100000:1.0:1788620168.845969:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773184 00000100:00100000:1.0:1788620168.846008:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788620168.846017:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061773184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620168.846129:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620168.846143:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c549600/0x24857de440bd04f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd04eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.846167:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c549600/0x24857de440bd04f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd04eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.846188:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c549600/0x24857de440bd04f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd04eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.846196:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549600, rc 0) 00000100:00100000:1.0:1788620168.846233:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061773184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620168.846240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788620168.847376:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620168.847395:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.847406:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620168.847468:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620168.847509:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620168.847551:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.847935:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773312 00000100:00100000:3.0:1788620168.847942:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773312 00000100:00100000:3.0:1788620168.847982:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788620168.847991:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061773312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.848393:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061773312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.848400:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788620168.848898:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620168.848940:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620168.848986:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620168.849017:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cecc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620168.849420:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773440 00000100:00100000:1.0:1788620168.849426:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773440 00000100:00100000:1.0:1788620168.849532:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788620168.849540:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061773440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620168.849696:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061773440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620168.849703:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788620168.849734:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.863953:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8477:1875504061773568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.864888:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.864932:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773568 00000100:00100000:3.0:1788620168.864940:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773568 00000100:00100000:3.0:1788620168.864987:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788620168.864996:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8477:x1875504061773568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.866242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8477:x1875504061773568:12345-0@lo:502:llog_process_th.0 Request processed in 1241us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.866271:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788620168.866335:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.866364:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8477:1875504061773568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620168.866398:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620168.866409:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620168.866411:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788620168.866419:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788620168.866451:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8477:1875504061773696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.866491:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.866519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773696 00000100:00100000:3.0:1788620168.866524:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773696 00000100:00100000:3.0:1788620168.866555:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788620168.866563:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8477:x1875504061773696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620168.868345:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8477:x1875504061773696:12345-0@lo:502:llog_process_th.0 Request processed in 1775us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.868359:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788620168.868432:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.868453:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8477:1875504061773696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620168.868487:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620168.868494:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620168.868496:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620168.868501:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788620168.868563:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788620168.868579:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788620168.868589:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.868600:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620168.868621:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788620168.868624:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0d664da4d28 from 1 10000000:01000000:3.0:1788620168.868627:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788620168.870865:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.870880:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.870891:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.870917:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.870975:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.871009:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.871744:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773824 00000100:00100000:3.0:1788620168.871753:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773824 00000100:00100000:3.0:1788620168.872170:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788620168.872180:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061773824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620168.872195:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620168.872209:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924800/0x24857de440bd0500 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd04f9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.872234:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924800/0x24857de440bd0500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd04f9 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.872245:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924800/0x24857de440bd0500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd04f9 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.872284:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924800, rc 0) 00000100:00100000:3.0:1788620168.872336:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061773824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.872342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788620168.872395:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620168.872411:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0500 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.872421:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0500 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.872483:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.872515:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.872539:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620168.872550:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061773952 00000100:00100000:3.0:1788620168.872555:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061773952 00000100:00100000:3.0:1788620168.872571:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788620168.872577:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061773952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620168.876553:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061773952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3966us (4029us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620168.876567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788620168.878348:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061773952:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788620168.878400:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788620168.878420:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0500 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620168.878432:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0500 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620169.064542:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620169.064566:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061774080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620169.064647:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620169.064777:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.064810:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620169.064834:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061774720:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.064874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620169.064893:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788620169.064899:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.064923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620169.064954:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061774464:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.064978:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620169.064995:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620169.065001:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061774592:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065147:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620169.065176:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061774208 00000100:00100000:0.0:1788620169.065183:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061774208 00000100:00100000:0.0:1788620169.065234:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788620169.065243:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061774208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061774208:12345-0@lo:400:kworker.0 Request processed in 71us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620169.065330:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788620169.065364:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061774720 00000100:00100000:0.0:1788620169.065368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061774720 00000100:00100000:0.0:1788620169.065394:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061774336 00000100:00100000:0.0:1788620169.065397:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061774336 00000100:00100000:0.0:1788620169.065406:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061774464 00000100:00100000:0.0:1788620169.065408:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061774464 00000100:00100000:0.0:1788620169.065423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788620169.065429:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061774720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065462:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061774720:12345-0@lo:400:kworker.0 Request processed in 33us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620169.065469:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788620169.065481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620169.065487:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061774336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065513:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061774336:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620169.065520:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620169.065531:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620169.065537:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061774464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065566:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061774464:12345-0@lo:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620169.065573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620169.065591:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061774592 00000100:00100000:0.0:1788620169.065594:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061774592 00000100:00100000:0.0:1788620169.065620:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620169.065627:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061774592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065665:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061774592:12345-0@lo:400:kworker.0 Request processed in 38us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620169.065671:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620169.065705:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065713:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065721:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061774720:0@lo:400:kworker.0 00000100:00080000:0.0:1788620169.065748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620169.065752:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788620169.065767:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084f480 x1875504061774592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620169.065778:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061774592:0@lo:400:kworker.0 00000100:00100000:0.0:1788620169.065787:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061774464:0@lo:400:kworker.0 00000100:00100000:3.0:1788620169.066539:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061774080 00000100:00100000:3.0:1788620169.066548:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061774080 00000100:00100000:3.0:1788620169.066605:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620169.066613:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061774080:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788620169.066710:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788620169.066764:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620169.066872:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061774080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 260us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620169.066879:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788620169.072006:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a30380 x1875504061774080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620169.072172:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061774080:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788620169.237651:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc196a2780 20000000:00000080:1.0:1788620169.237670:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0d67f6a0800 uarg=0000000000000000 20000000:01000000:1.0:1788620169.237706:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788620169.237711:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788620169.237715:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788620169.238792:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788620169.238949:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788620169.244412:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788620169.244472:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788620169.244530:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788620169.244548:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788620169.244567:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244585:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641642000/0x24857de440bd027c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0275 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244593:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd02d7 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244600:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd03a2 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244609:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244616:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244776:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244794:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 9 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620169.244819:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061774848:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620169.244934:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd03a2 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.244944:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd03a2 expref: 18 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620169.244954:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061774976:0@lo:104: 00000100:00100000:3.0:1788620169.244996:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620169.245042:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd02d7 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.245051:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd02d7 expref: 18 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620169.245059:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061775104:0@lo:104: 00000100:00100000:3.0:1788620169.245085:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620169.245112:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641642000/0x24857de440bd027c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0275 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.245121:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d641642000/0x24857de440bd027c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0275 expref: 18 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620169.245129:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061775232:0@lo:104: 00000100:00100000:3.0:1788620169.245147:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620169.245288:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788620169.245305:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620169.245316:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061774976 00000100:00100000:1.0:1788620169.245322:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061774976 00000100:00100000:1.0:1788620169.245357:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061775104 00000100:00100000:1.0:1788620169.245360:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061775104 00000100:00100000:1.0:1788620169.245370:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061775232 00000100:00100000:1.0:1788620169.245372:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061775232 00000100:00100000:1.0:1788620169.245385:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788620169.245393:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+5:8502:x1875504061774976:12345-0@lo:104: 00010000:00010000:1.0:1788620169.245405:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245472:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620169.245479:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+5:8502:x1875504061774976:12345-0@lo:104: Request processed in 87us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620169.245486:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788620169.245504:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620169.245511:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a617c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8502:x1875504061775104:12345-0@lo:104: 00010000:00010000:1.0:1788620169.245518:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245549:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788620169.245553:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a617c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:8502:x1875504061775104:12345-0@lo:104: Request processed in 44us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620169.245557:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620169.245580:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788620169.245583:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8502:x1875504061775232:12345-0@lo:104: 00010000:00010000:1.0:1788620169.245588:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245608:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788620169.245610:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:8502:x1875504061775232:12345-0@lo:104: Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620169.245614:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788620169.245746:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788620169.245752:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245759:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031c00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620169.245769:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245777:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620169.245784:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620169.245790:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788620169.245820:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245827:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620169.245858:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245865:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d640031c00/0x24857de440bd03a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd03a9 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245879:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620169.245882:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245888:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643600 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620169.245891:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245898:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620169.245914:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620169.245919:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788620169.245933:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245939:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620169.245954:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245961:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd02d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd02de expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245971:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620169.245974:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245980:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031800 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620169.245982:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.245988:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620169.245994:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620169.245998:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788620169.246018:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.246024:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620169.246030:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.246037:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d640031800/0x24857de440bd0275 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd027c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.246048:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620169.246049:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620169.246051:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620169.246063:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061775488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620169.246094:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620169.246118:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620169.246124:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061775616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620169.246145:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620169.246175:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061775488 00000100:00100000:1.0:1788620169.246180:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061775488 00010000:00010000:1.0:1788620169.246201:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd02d7 expref: 19 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620169.246221:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061775616 00000100:00100000:1.0:1788620169.246224:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061775616 00010000:00010000:1.0:1788620169.246234:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641642000/0x24857de440bd027c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0275 expref: 20 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620169.246466:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620169.246473:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620169.246769:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061774976:0@lo:104: 00000100:00100000:3.0:1788620169.246779:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061775104:0@lo:104: 00000100:00100000:3.0:1788620169.246797:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061775232:0@lo:104: 00000100:00100000:1.0:1788620169.246877:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788620169.246887:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+20:3310:x1875504061775488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620169.246908:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620169.246914:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd02d7 expref: 20 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.246924:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd02d7 expref: 20 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.246937:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c549200/0x24857de440bd02de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd02d7 expref: 20 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.246950:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620169.247029:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061775488:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620169.247036:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788620169.247053:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788620169.247060:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:3310:x1875504061775616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620169.247068:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620169.247072:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641642000/0x24857de440bd027c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0275 expref: 18 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.247080:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641642000/0x24857de440bd027c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0275 expref: 18 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.247090:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642000/0x24857de440bd027c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0275 expref: 18 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.247099:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620169.247122:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3310:x1875504061775616:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620169.247137:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788620169.249808:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875504061774848:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620169.249859:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620169.250499:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061775360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620169.250573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620169.250745:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061775360 00000100:00100000:3.0:1788620169.250752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061775360 00010000:00010000:3.0:1788620169.250784:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03a2 expref: 17 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620169.250822:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788620169.250831:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3309:x1875504061775360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620169.250878:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620169.250884:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd03a2 expref: 17 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.250895:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd03a2 expref: 17 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.250913:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640030e00/0x24857de440bd03a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd03a2 expref: 17 pid: 5833 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.250929:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620169.250966:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3309:x1875504061775360:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620169.250973:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788620169.251003:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061775360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620169.253422:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620169.253463:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971648 00000100:00100000:1.0:1788620169.253471:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971648 00010000:00010000:1.0:1788620169.253509:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 10 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620169.253543:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:1.0:1788620169.253552:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2355:x1875504044971648:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620169.253565:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620169.253571:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 10 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253586:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 10 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253605:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680925400/0x24857de440bd0466 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21bb expref: 10 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253631:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253640:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253658:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253682:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253689:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253696:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253703:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620169.253707:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253716:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253731:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620169.253741:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620169.253802:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:2355:x1875504044971648:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 250us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620169.253810:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 24 00010000:00010000:3.0:1788620169.254424:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.254444:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620169.254450:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924200/0x24857de440bd0507 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620169.261296:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061775488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620169.262203:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061775616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620169.515378:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620169.583285:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061775744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620169.583354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620169.583873:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061775744 00000100:00100000:2.0:1788620169.583882:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061775744 00000100:00100000:2.0:1788620169.584046:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620169.584059:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061775744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620169.584094:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620169.584146:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061775744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620169.584152:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788620169.584184:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a30380 x1875504061775744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620169.584202:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061775744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788620170.537107:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620170.695311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620170.695392:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971776 00000100:00100000:3.0:1788620170.695403:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971776 00000100:00100000:3.0:1788620170.695454:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 169 00000100:00100000:3.0:1788620170.695464:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:5593:x1875504044971776:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620170.695480:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620170.695498:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b21fa expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.695525:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.695537:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.695546:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924200, rc 0) 00000100:00100000:3.0:1788620170.695616:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044971776:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 153us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.695624:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 169 00000100:00100000:3.0:1788620170.703228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620170.703287:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044971904 00000100:00100000:3.0:1788620170.703297:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044971904 00000100:00100000:3.0:1788620170.703344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 170 00000100:00100000:3.0:1788620170.703353:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044971904:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.703616:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044971904:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 263us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.703625:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 170 00000100:00100000:1.0:1788620170.711870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620170.711962:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972032 00000100:00100000:3.0:1788620170.711972:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972032 00000100:00100000:3.0:1788620170.712033:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 171 00000100:00100000:3.0:1788620170.712044:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044972032:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.712304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:5593:x1875504044972032:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 Request processed in 261us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.712313:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 171 00000100:00100000:3.0:1788620170.720915:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620170.721134:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972160 00000100:00100000:1.0:1788620170.721144:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972160 00000100:00100000:1.0:1788620170.721198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 172 00000100:00100000:1.0:1788620170.721209:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:6121:x1875504044972160:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620170.721487:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:6121:x1875504044972160:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 279us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620170.721495:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 172 00000100:00100000:3.0:1788620170.731688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620170.733446:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972288 00000100:00100000:1.0:1788620170.733458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972288 00000100:00100000:1.0:1788620170.733525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 173 00000100:00100000:1.0:1788620170.733536:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:6121:x1875504044972288:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620170.733847:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:6121:x1875504044972288:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 311us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620170.733855:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 173 10000000:01000000:1.0:1788620170.792383:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788620170.792392:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d675d13000 from 4 10000000:01000000:1.0:1788620170.792397:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788620170.792442:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620170.792454:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620170.792466:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620170.792491:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061775872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788620170.792559:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620170.792625:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.792826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061775872 00000100:00100000:2.0:1788620170.792834:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061775872 00000100:00100000:2.0:1788620170.792900:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788620170.792909:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061775872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620170.792922:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620170.792935:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0515 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.792957:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0515 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.792982:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0515 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.793001:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2400, rc 0) 00000100:00100000:2.0:1788620170.793040:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061775872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.793047:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788620170.793274:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061775872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620170.793288:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620170.793304:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620170.793361:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620170.793387:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620170.793401:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.793455:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776000 00000100:00100000:2.0:1788620170.793459:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776000 00000100:00100000:2.0:1788620170.793491:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788620170.793498:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061776000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.793752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061776000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.793760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788620170.793901:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620170.793930:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620170.793966:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620170.794270:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.794422:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776128 00000100:00100000:2.0:1788620170.794427:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776128 00000100:00100000:2.0:1788620170.794463:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788620170.794470:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061776128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.799374:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061776128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4893us (5395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.799391:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788620170.799494:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620170.799928:0:8563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8563:1875504061776256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620170.799978:0:8563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620170.800016:0:8563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.800066:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776256 00000100:00100000:2.0:1788620170.800073:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776256 00000100:00100000:2.0:1788620170.800113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788620170.800122:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8563:x1875504061776256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620170.800343:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8563:x1875504061776256:12345-0@lo:502:llog_process_th.0 Request processed in 222us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.800351:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788620170.800452:0:8563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8563:1875504061776256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788620170.800474:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620170.800484:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620170.800486:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788620170.800492:0:8563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d675d13000 00000020:00000080:1.0:1788620170.800495:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788620170.801502:0:8563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8563:1875504061776384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620170.801557:0:8563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620170.801581:0:8563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.802027:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776384 00000100:00100000:2.0:1788620170.802034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776384 00000100:00100000:2.0:1788620170.802071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788620170.802078:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8563:x1875504061776384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620170.802276:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:8563:x1875504061776384:12345-0@lo:502:llog_process_th.0 Request processed in 197us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.802284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788620170.805419:0:8563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8563:1875504061776384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620170.805469:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620170.805477:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620170.805479:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788620170.805485:0:8563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788620170.806338:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788620170.806360:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620170.806370:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.806382:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620170.806393:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788620170.806395:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d680c0a000 from 4 10000000:01000000:2.0:1788620170.806398:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788620170.806432:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.806440:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.806448:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620170.806481:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.806544:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.806583:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664dbf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.806601:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776512 00000100:00100000:2.0:1788620170.806607:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776512 00000100:00100000:2.0:1788620170.806647:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788620170.806656:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061776512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620170.806670:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620170.806682:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0523 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.806704:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0523 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.806715:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0523 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.806724:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2200, rc 0) 00000100:00100000:2.0:1788620170.806758:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061776512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.806765:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788620170.806804:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620170.806829:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.806838:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620170.806888:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.806913:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.806926:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664dbf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.806938:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776640 00000100:00100000:2.0:1788620170.806941:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776640 00000100:00100000:2.0:1788620170.806960:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788620170.806966:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061776640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.807204:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061776640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.807211:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788620170.807241:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.807289:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.807325:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.807337:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664dbf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.807349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776768 00000100:00100000:2.0:1788620170.807352:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776768 00000100:00100000:2.0:1788620170.807372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788620170.807377:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061776768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.807503:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061776768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.807509:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788620170.807546:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061776768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.810608:0:8566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8566:1875504061776896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620170.810691:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620170.810739:0:8566:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620170.810768:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061776896 00000100:00100000:3.0:1788620170.810774:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061776896 00000100:00100000:3.0:1788620170.810812:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788620170.810831:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8566:x1875504061776896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620170.811029:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8566:x1875504061776896:12345-0@lo:502:llog_process_th.0 Request processed in 198us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.811036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788620170.814027:0:8566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8566:1875504061776896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620170.814072:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620170.814082:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620170.814084:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788620170.814092:0:8566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d680c0a000 00000020:00000080:3.0:1788620170.814094:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788620170.814183:0:8566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8566:1875504061777024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620170.814273:0:8566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620170.814293:0:8566:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620170.815376:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777024 00000100:00100000:2.0:1788620170.815393:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777024 00000100:00100000:2.0:1788620170.815443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788620170.815453:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8566:x1875504061777024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620170.816199:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:8566:x1875504061777024:12345-0@lo:502:llog_process_th.0 Request processed in 745us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620170.816209:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788620170.818463:0:8566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8566:1875504061777024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788620170.818507:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620170.818514:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620170.818517:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788620170.818521:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788620170.827152:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788620170.827187:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620170.827199:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.827466:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620170.827480:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620170.827483:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d649f43000 from 4 10000000:01000000:3.0:1788620170.827485:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620170.827526:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.827535:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.827547:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620170.827572:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061777152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.827643:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620170.827689:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620170.828304:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777152 00000100:00100000:3.0:1788620170.828315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777152 00000100:00100000:3.0:1788620170.828364:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788620170.828374:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061777152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620170.828809:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620170.828837:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd0531 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.828867:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd0531 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.828970:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0531 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.828979:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924a00, rc 0) 00000100:00100000:3.0:1788620170.829040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061777152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 667us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.829046:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788620170.829337:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061777152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620170.829358:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.829367:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620170.829966:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061777280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.830018:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620170.830047:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620170.830077:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777280 00000100:00100000:3.0:1788620170.830083:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777280 00000100:00100000:3.0:1788620170.830535:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788620170.830546:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061777280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.831107:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061777280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 550us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.831117:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788620170.831172:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061777280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.831707:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061777408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.831771:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620170.831791:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620170.831811:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777408 00000100:00100000:3.0:1788620170.831828:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777408 00000100:00100000:3.0:1788620170.831861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788620170.831869:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061777408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.832778:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061777408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 907us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.832789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788620170.832861:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061777408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.854468:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8571:1875504061777536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620170.854547:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.854646:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cc9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620170.854839:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777536 00000100:00100000:3.0:1788620170.854846:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777536 00000100:00100000:3.0:1788620170.854891:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788620170.854900:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:8571:x1875504061777536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620170.855100:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:8571:x1875504061777536:12345-0@lo:502:llog_process_th.0 Request processed in 200us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.855108:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788620170.859957:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8571:1875504061777536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788620170.860003:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620170.860014:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620170.860017:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788620170.860024:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d649f43000 00000020:00000080:2.0:1788620170.860027:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788620170.860315:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8571:1875504061777664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620170.860383:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.860427:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cc9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620170.864501:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777664 00000100:00100000:3.0:1788620170.864517:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777664 00000100:00100000:3.0:1788620170.864579:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788620170.864591:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:8571:x1875504061777664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620170.864866:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:8571:x1875504061777664:12345-0@lo:502:llog_process_th.0 Request processed in 276us (4482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.864874:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788620170.867758:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:8571:1875504061777664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788620170.867802:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620170.867811:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620170.867825:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788620170.867830:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788620170.867923:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788620170.867943:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620170.867954:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.867966:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620171.561890:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620172.591600:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620173.623531:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620173.644859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620173.644899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620173.644947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620173.644976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620173.645014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972416 00000100:00100000:2.0:1788620173.645024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972416 00000100:00100000:2.0:1788620173.645070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 189 00000100:00100000:2.0:1788620173.645080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044972416:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620173.645145:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044972416:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620173.645152:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 189 00000100:00100000:2.0:1788620173.645183:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972672 00000100:00100000:2.0:1788620173.645187:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972672 00000100:00100000:2.0:1788620173.645222:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972800 00000100:00100000:2.0:1788620173.645226:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972800 00000100:00100000:2.0:1788620173.645245:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:2.0:1788620173.645270:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2356:x1875504044972672:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620173.645297:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2356:x1875504044972672:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620173.645303:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:2.0:1788620173.645315:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:2.0:1788620173.645320:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2356:x1875504044972800:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620173.645341:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2356:x1875504044972800:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 21us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620173.645347:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:2.0:1788620173.645363:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972544 00000100:00100000:2.0:1788620173.645366:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972544 00000100:00100000:2.0:1788620173.645393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:2.0:1788620173.645406:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044972544:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620173.645433:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044972544:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620173.645439:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00080000:2.0:1788620173.646038:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788620173.646044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620173.646046:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620174.184943:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620174.184969:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061777792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620174.185045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.185114:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777792 00000100:00100000:3.0:1788620174.185122:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777792 00000100:00100000:3.0:1788620174.185185:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788620174.185195:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061777792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620174.185234:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620174.185309:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061777792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620174.185317:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788620174.185338:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788620174.185372:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a33480 x1875504061777792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620174.185392:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061777792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620174.186642:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061778048:0@lo:400:kworker.0 00000100:00100000:1.0:1788620174.186693:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.186732:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788620174.186738:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061777920:0@lo:400:kworker.0 00000100:00100000:1.0:1788620174.186777:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.186801:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061778432:0@lo:400:kworker.0 00000100:00100000:1.0:1788620174.186820:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.186869:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778048 00000100:00100000:1.0:1788620174.186875:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778048 00000100:00100000:1.0:1788620174.186914:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778432 00000100:00100000:1.0:1788620174.186918:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778432 00000100:00100000:1.0:1788620174.186949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788620174.186963:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061778048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620174.187017:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061778048:12345-0@lo:400:kworker.0 Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620174.187077:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061777920 00000100:00100000:3.0:1788620174.187082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061777920 00000100:00100000:3.0:1788620174.187646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788620174.187656:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061777920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620174.187709:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061777920:12345-0@lo:400:kworker.0 Request processed in 56us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620174.187716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788620174.187780:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788620174.187788:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788620174.187803:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620174.187816:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061778304:0@lo:400:kworker.0 00000100:00100000:3.0:1788620174.187859:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.187882:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788620174.187888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061778176:0@lo:400:kworker.0 00000100:00100000:3.0:1788620174.187912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.188036:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778176 00000100:00100000:3.0:1788620174.188041:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778176 00000100:00100000:2.0:1788620174.188096:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778304 00000100:00100000:2.0:1788620174.188101:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778304 00000100:00100000:2.0:1788620174.188135:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620174.188143:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061778304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620174.188186:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061778304:12345-0@lo:400:kworker.0 Request processed in 44us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620174.188192:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788620174.188227:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67f815c00 x1875504061778304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620174.188241:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061778304:0@lo:400:kworker.0 00000100:00100000:0.0:1788620174.191910:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620174.191931:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061778432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620174.192014:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061778432:12345-0@lo:400:kworker.0 Request processed in 93us (5193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.192022:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788620174.193701:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788620174.193811:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061777920:0@lo:400:kworker.0 00000100:00100000:1.0:1788620174.193931:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061778432:0@lo:400:kworker.0 00000100:00100000:1.0:1788620174.193949:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061778048:0@lo:400:kworker.0 00000100:00100000:3.0:1788620174.194295:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788620174.194315:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061778176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620174.194417:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061778176:12345-0@lo:400:kworker.0 Request processed in 112us (6504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620174.194426:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788620174.194467:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061778176:0@lo:400:kworker.0 00000100:00080000:3.0:1788620174.194491:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620174.194497:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788620174.632434:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620174.696495:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620174.696517:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061778560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620174.696586:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.696659:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778560 00000100:00100000:3.0:1788620174.696668:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778560 00000100:00100000:3.0:1788620174.696718:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788620174.696737:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061778560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620174.696785:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620174.696832:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061778560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620174.696838:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788620174.696878:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680a30e00 x1875504061778560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620174.696895:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061778560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620175.656418:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620175.729414:0:8804:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788620176.690073:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620177.704739:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620178.728532:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620178.766227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620178.766279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620178.766311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620178.766337:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620178.766372:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973184 00000100:00100000:1.0:1788620178.766392:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973184 00000100:00100000:1.0:1788620178.766457:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973312 00000100:00100000:1.0:1788620178.766461:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973312 00000100:00100000:1.0:1788620178.766484:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:1.0:1788620178.766494:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044973184:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620178.766561:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044973184:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620178.766569:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:1.0:1788620178.766585:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:1.0:1788620178.766591:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044973312:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620178.766612:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044973312:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 21us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620178.766618:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:1.0:1788620178.766634:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973056 00000100:00100000:1.0:1788620178.766638:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973056 00000100:00100000:1.0:1788620178.766666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:1.0:1788620178.766672:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044973056:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620178.766711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044973056:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620178.766718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00080000:1.0:1788620178.766736:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788620178.766740:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788620178.766742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620178.767426:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044972928 00000100:00100000:3.0:1788620178.767443:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044972928 00000100:00100000:3.0:1788620178.767478:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 191 00000100:00100000:3.0:1788620178.767486:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2353:x1875504044972928:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620178.767528:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2353:x1875504044972928:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 43us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620178.767535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 191 00000100:00100000:3.0:1788620179.316366:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061778688:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.316435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620179.316493:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061779200:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.316527:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620179.316555:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788620179.316561:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061778816:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.316581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620179.316596:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061779328:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.316617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620179.316657:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061778944:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.316692:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620179.316709:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620179.316716:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061779072:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.316735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620179.316782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778688 00000100:00100000:3.0:1788620179.316788:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778688 00000100:00100000:3.0:1788620179.316829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788620179.316838:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061778688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.316886:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061778688:12345-0@lo:400:kworker.0 Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620179.316893:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788620179.316928:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779200 00000100:00100000:3.0:1788620179.316931:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779200 00000100:00100000:3.0:1788620179.316961:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778816 00000100:00100000:3.0:1788620179.316963:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778816 00000100:00100000:3.0:1788620179.316974:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061778944 00000100:00100000:3.0:1788620179.316977:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061778944 00000100:00100000:3.0:1788620179.316993:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788620179.316999:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061779200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317030:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061779200:12345-0@lo:400:kworker.0 Request processed in 31us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620179.317037:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788620179.317050:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788620179.317055:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061778816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317077:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061778816:12345-0@lo:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620179.317092:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788620179.317102:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788620179.317107:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061778944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317145:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061778944:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620179.317151:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788620179.317170:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779328 00000100:00100000:3.0:1788620179.317173:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779328 00000100:00100000:3.0:1788620179.317194:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779072 00000100:00100000:3.0:1788620179.317196:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779072 00000100:00100000:3.0:1788620179.317211:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788620179.317217:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061779328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317240:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061779328:12345-0@lo:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620179.317246:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788620179.317430:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788620179.317437:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061779072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317466:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061779072:12345-0@lo:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620179.317471:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788620179.317514:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061778816:0@lo:400:kworker.0 00010000:00080000:3.0:1788620179.317527:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67f817800 x1875504061779328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620179.317537:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061779328:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317545:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061778688:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317563:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061779200:0@lo:400:kworker.0 00000100:00080000:3.0:1788620179.317588:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620179.317592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620179.317595:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620179.317613:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67f814700 x1875504061779072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620179.317622:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061779072:0@lo:400:kworker.0 00000100:00100000:3.0:1788620179.317631:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061778944:0@lo:400:kworker.0 00000100:00100000:0.0:1788620179.322365:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620179.322390:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061779456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620179.322470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620179.322680:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779456 00000100:00100000:2.0:1788620179.322689:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779456 00000100:00100000:2.0:1788620179.322746:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788620179.322757:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061779456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620179.322791:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620179.322838:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061779456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620179.322852:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788620179.323243:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084f100 x1875504061779456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620179.323305:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061779456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788620179.759376:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620179.818304:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620179.818329:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061779584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620179.818408:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620179.818497:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779584 00000100:00100000:0.0:1788620179.818506:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779584 00000100:00100000:0.0:1788620179.818556:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788620179.818567:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061779584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620179.818602:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620179.818649:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061779584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620179.818669:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788620179.819224:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084f100 x1875504061779584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620179.819244:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061779584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788620180.776548:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788620180.881375:0:9048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing yml_node 00010000:00010000:1.0:1788620181.809335:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620182.824483:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620183.849000:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620183.889302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620183.889369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620183.889463:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973568 00000100:00100000:3.0:1788620183.889473:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973568 00000100:00100000:3.0:1788620183.889549:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:3.0:1788620183.889562:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504044973568:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620183.889652:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504044973568:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 93us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620183.889660:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00080000:2.0:1788620183.891701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620183.900074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620183.900130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620183.900414:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973696 00000100:00100000:2.0:1788620183.900424:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973696 00000100:00100000:2.0:1788620183.900484:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973824 00000100:00100000:2.0:1788620183.900488:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973824 00000100:00100000:2.0:1788620183.900509:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:2.0:1788620183.900519:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2352:x1875504044973696:12345-192.168.201.11@tcp:9:kworker.0 00000020:00000080:2.0:1788620183.900558:0:7779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0474 00000100:00080000:2.0:1788620183.900568:0:7779:0:(import.c:65:import_set_state_nolock()) ffffa0d67a542000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788620183.900617:0:7779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788620183.900987:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+2:2352:x1875504044973696:12345-192.168.201.11@tcp:9:kworker.0 Request processed in 467us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620183.900995:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:2.0:1788620183.901013:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:2.0:1788620183.901020:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2352:x1875504044973824:12345-192.168.201.11@tcp:9:kworker.0 00000020:00000080:2.0:1788620183.901034:0:7779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd047b 00000100:00080000:2.0:1788620183.901041:0:7779:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788620183.901064:0:7779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788620183.901414:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+2:2352:x1875504044973824:12345-192.168.201.11@tcp:9:kworker.0 Request processed in 393us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620183.901422:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00010000:00010000:2.0:1788620183.901441:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620183.901497:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788620183.901784:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788620183.901789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620183.902449:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973440 00000100:00100000:0.0:1788620183.902458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973440 00000100:00100000:0.0:1788620183.903136:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 193 00000100:00100000:0.0:1788620183.903148:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2354:x1875504044973440:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620183.903239:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2354:x1875504044973440:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 94us (13869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620183.903275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 193 00000100:00100000:3.0:1788620184.424611:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061779712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620184.424694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620184.425332:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061779968:0@lo:400:kworker.0 00000100:00100000:2.0:1788620184.425391:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620184.425429:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620184.425436:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061780096:0@lo:400:kworker.0 00000100:00100000:2.0:1788620184.425461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620184.425665:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779968 00000100:00100000:3.0:1788620184.425674:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779968 00000100:00100000:3.0:1788620184.425723:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780096 00000100:00100000:3.0:1788620184.425726:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780096 00000100:00100000:3.0:1788620184.425767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788620184.425778:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061779968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.425834:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061779968:12345-0@lo:400:kworker.0 Request processed in 58us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620184.425852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788620184.425883:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788620184.425890:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061780096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.425919:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061780096:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620184.425925:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788620184.425950:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061779840:0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.425980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620184.426005:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061780352:0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.426028:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620184.426046:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788620184.426051:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061780224:0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.426074:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620184.426097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779840 00000100:00100000:3.0:1788620184.426100:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779840 00000100:00100000:3.0:1788620184.426126:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788620184.426131:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061779840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.426163:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061779840:12345-0@lo:400:kworker.0 Request processed in 32us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620184.426169:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788620184.426210:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061779840:0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.426240:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061780096:0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.426279:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061779968:0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.426315:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780352 00000100:00100000:3.0:1788620184.426319:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780352 00000100:00100000:3.0:1788620184.426342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788620184.426348:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061780352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620184.426530:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780224 00000100:00100000:2.0:1788620184.426535:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780224 00000100:00100000:2.0:1788620184.426569:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788620184.426587:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061780224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620184.426628:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061780224:12345-0@lo:400:kworker.0 Request processed in 53us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620184.426634:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788620184.426666:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680b75f80 x1875504061780224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620184.426678:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061780224:0@lo:400:kworker.0 00000100:00100000:3.0:1788620184.426952:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061780352:12345-0@lo:400:kworker.0 Request processed in 603us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620184.426959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788620184.427048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620184.427053:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620184.427119:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061780352:0@lo:400:kworker.0 00000100:00100000:0.0:1788620184.427197:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061779712 00000100:00100000:0.0:1788620184.427212:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061779712 00000100:00100000:0.0:1788620184.427299:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788620184.427308:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061779712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620184.427335:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620184.427392:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061779712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620184.427852:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788620184.427971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788620184.428034:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084f100 x1875504061779712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620184.428053:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061779712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788620184.872856:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620184.937203:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788620184.937227:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061780480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620184.937317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620184.937609:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780480 00000100:00100000:0.0:1788620184.937619:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780480 00000100:00100000:0.0:1788620184.937686:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788620184.937695:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061780480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620184.937738:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620184.937798:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061780480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620184.937805:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788620184.937928:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084dc00 x1875504061780480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620184.937947:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061780480:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788620185.619072:0:9240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.85 00010000:00010000:1.0:1788620185.896597:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620186.925327:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788620187.594218:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:2.0:1788620187.594228:0:6712:0:(genops.c:885:class_export_put()) final put ffffa0d67a544000/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:1.0:1788620187.594311:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a544000/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a for lustre-OST0000 00000020:00000080:1.0:1788620187.594370:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67a542000 for lustre-OST0000 00010000:00010000:2.0:1788620187.945726:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788620188.092470:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:0.0:1788620188.092480:0:7638:0:(genops.c:885:class_export_put()) final put ffffa0d680a2a000/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:0.0:1788620188.092523:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680a2a000/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a for lustre-OST0001 00000020:00000080:0.0:1788620188.092580:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d680a2c800 for lustre-OST0001 00000001:02000400:0.0:1788620188.503085:0:9340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.85 00010000:00010000:2.0:1788620188.970179:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620188.998705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620188.998760:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620188.998793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044973952 00000100:00100000:2.0:1788620188.998819:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044973952 00000100:00100000:2.0:1788620188.998873:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 195 00000100:00100000:2.0:1788620188.998886:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2355:x1875504044973952:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620188.998961:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2355:x1875504044973952:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620188.998969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 195 00000100:00100000:0.0:1788620188.999218:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974080 00000100:00100000:0.0:1788620188.999223:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974080 00000100:00100000:0.0:1788620188.999296:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:0.0:1788620188.999304:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044974080:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620188.999344:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044974080:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 42us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620188.999351:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00080000:2.0:1788620188.999514:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620189.545716:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061780992:0@lo:400:kworker.0 00000100:00100000:2.0:1788620189.545791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620189.546233:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788620189.546245:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061780608:0@lo:400:kworker.0 00000100:00100000:2.0:1788620189.546421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620189.546458:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061781120:0@lo:400:kworker.0 00000100:00100000:2.0:1788620189.546485:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620189.546526:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061780736:0@lo:400:kworker.0 00000100:00100000:2.0:1788620189.546552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620189.546571:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061781248:0@lo:400:kworker.0 00000100:00100000:0.0:1788620189.546717:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780608 00000100:00100000:0.0:1788620189.546725:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780608 00000100:00100000:0.0:1788620189.546772:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788620189.546782:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061780608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620189.546837:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061780608:12345-0@lo:400:kworker.0 Request processed in 57us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620189.546845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788620189.547005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061781120 00000100:00100000:3.0:1788620189.547009:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061781120 00000100:00100000:3.0:1788620189.547044:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780736 00000100:00100000:3.0:1788620189.547048:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780736 00000100:00100000:3.0:1788620189.547066:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788620189.547072:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061781120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620189.547218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620189.547466:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780992 00000100:00100000:0.0:1788620189.547471:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780992 00000100:00100000:0.0:1788620189.547507:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061781248 00000100:00100000:0.0:1788620189.547510:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061781248 00000100:00100000:0.0:1788620189.547534:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788620189.547541:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061780992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620189.547579:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061780992:12345-0@lo:400:kworker.0 Request processed in 38us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620189.547585:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620189.547790:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788620189.547800:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061781248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.547837:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061781248:12345-0@lo:400:kworker.0 Request processed in 40us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.547843:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620189.548651:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061781120:12345-0@lo:400:kworker.0 Request processed in 1577us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620189.548661:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788620189.548685:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788620189.548693:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061780736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620189.548742:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061780736:12345-0@lo:400:kworker.0 Request processed in 50us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620189.548748:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788620189.548787:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061780864:0@lo:400:kworker.0 00000100:00100000:3.0:1788620189.548821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.548848:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061781376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620189.548889:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788620189.548922:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620189.548927:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620189.548930:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620189.548941:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061780864 00000100:00100000:3.0:1788620189.548947:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061780864 00000100:00100000:3.0:1788620189.548980:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788620189.548987:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061780864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620189.549022:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061780864:12345-0@lo:400:kworker.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620189.549028:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788620189.549050:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061781376 00000100:00100000:3.0:1788620189.549054:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061781376 00000100:00100000:3.0:1788620189.549077:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788620189.549084:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061781376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620189.549115:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620189.549146:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061781376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620189.549152:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788620189.549166:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620189.549193:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061780864:0@lo:400:kworker.0 00010000:00080000:3.0:1788620189.549213:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084e680 x1875504061781376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620189.549228:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061781376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620189.549315:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061780608:0@lo:400:kworker.0 00000100:00100000:3.0:1788620189.549326:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061781120:0@lo:400:kworker.0 00010000:00080000:3.0:1788620189.549354:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680b75180 x1875504061780992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620189.549364:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061780992:0@lo:400:kworker.0 00000100:00100000:2.0:1788620189.550753:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061780736:0@lo:400:kworker.0 00010000:00080000:2.0:1788620189.550774:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680b76680 x1875504061781248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620189.550784:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061781248:0@lo:400:kworker.0 00010000:00010000:3.0:1788620189.993409:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620190.056675:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061781504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620190.056750:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620190.057175:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061781504 00000100:00100000:0.0:1788620190.057184:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061781504 00000100:00100000:0.0:1788620190.057244:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620190.057282:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061781504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620190.057317:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620190.057377:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061781504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620190.057385:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788620190.057466:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084e680 x1875504061781504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620190.057518:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061781504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620191.016442:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620191.291555:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.85 00010000:00010000:2.0:1788620192.040556:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620193.064382:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620193.138053:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 10:56:30 EDT 2026 00010000:00010000:1.0:1788620194.090437:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620194.122527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620194.122589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620194.122623:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974208 00000100:00100000:1.0:1788620194.122632:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974208 00000100:00100000:1.0:1788620194.122684:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 197 00000100:00100000:1.0:1788620194.122694:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044974208:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620194.122780:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044974208:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 87us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620194.122800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 197 00000100:00100000:3.0:1788620194.123042:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974336 00000100:00100000:3.0:1788620194.123048:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974336 00000100:00100000:3.0:1788620194.123113:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:3.0:1788620194.123121:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044974336:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620194.123158:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044974336:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620194.123165:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00080000:1.0:1788620194.123355:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620194.664658:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061781632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620194.664743:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.664888:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061781632 00000100:00100000:0.0:1788620194.664898:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061781632 00000100:00100000:0.0:1788620194.664965:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620194.664975:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061781632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620194.665024:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620194.665091:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061781632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.665099:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788620194.665142:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084dc00 x1875504061781632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620194.665162:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061781632:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788620194.665240:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620194.667767:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061781760:0@lo:400:kworker.0 00000100:00100000:2.0:1788620194.667842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.667945:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061781760 00000100:00100000:0.0:1788620194.667954:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061781760 00000100:00100000:0.0:1788620194.668007:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788620194.668019:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061781760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620194.668262:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061781888:0@lo:400:kworker.0 00000100:00100000:1.0:1788620194.668297:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.668731:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061781760:12345-0@lo:400:kworker.0 Request processed in 713us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.668740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788620194.668986:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061781760:0@lo:400:kworker.0 00000100:00100000:2.0:1788620194.669276:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061782016:0@lo:400:kworker.0 00000100:00100000:2.0:1788620194.669314:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.669467:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061781888 00000100:00100000:0.0:1788620194.669474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061781888 00000100:00100000:0.0:1788620194.669508:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782016 00000100:00100000:0.0:1788620194.669511:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782016 00000100:00100000:0.0:1788620194.669536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788620194.669544:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061781888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620194.669588:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061781888:12345-0@lo:400:kworker.0 Request processed in 45us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.669596:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788620194.669610:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788620194.669616:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061782016:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788620194.669677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620194.669710:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061781888:0@lo:400:kworker.0 00000100:00100000:1.0:1788620194.669733:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061782144:0@lo:400:kworker.0 00000100:00100000:1.0:1788620194.669764:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620194.670016:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782144 00000100:00100000:3.0:1788620194.670022:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782144 00000100:00100000:3.0:1788620194.670073:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788620194.670082:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061782144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.670144:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061782144:12345-0@lo:400:kworker.0 Request processed in 64us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620194.670151:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788620194.670170:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620194.670175:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788620194.670194:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061782272:0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.670238:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620194.670286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782272 00000100:00100000:3.0:1788620194.670291:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782272 00000100:00100000:3.0:1788620194.670318:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788620194.670324:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061782272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.670358:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061782272:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620194.670365:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788620194.670379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620194.670395:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061782272:0@lo:400:kworker.0 00010000:00080000:3.0:1788620194.670436:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675cec700 x1875504061782144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620194.670929:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061782144:0@lo:400:kworker.0 00000100:00100000:0.0:1788620194.671017:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061782016:12345-0@lo:400:kworker.0 Request processed in 1400us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.671037:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788620194.671175:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061782016:0@lo:400:kworker.0 00010000:00010000:2.0:1788620195.122926:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620195.185511:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061782400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620195.185591:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620195.186363:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782400 00000100:00100000:0.0:1788620195.186373:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782400 00000100:00100000:0.0:1788620195.187468:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788620195.187482:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061782400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620195.187519:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620195.187597:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061782400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620195.187604:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788620195.188674:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084dc00 x1875504061782400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620195.188700:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061782400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620196.143868:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620197.160531:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620198.186161:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620199.208429:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620199.239617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620199.239705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620199.239783:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974592 00000100:00100000:3.0:1788620199.239794:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974592 00000100:00080000:1.0:1788620199.239906:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620199.239945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:3.0:1788620199.239958:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044974592:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620199.240038:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044974592:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620199.240060:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:0.0:1788620199.240404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974464 00000100:00100000:0.0:1788620199.240409:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974464 00000100:00100000:0.0:1788620199.240474:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 199 00000100:00100000:0.0:1788620199.240482:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2353:x1875504044974464:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620199.240520:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2353:x1875504044974464:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620199.240527:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 199 00000100:00100000:3.0:1788620199.785546:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061782656:0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.785570:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061782528:0@lo:400:kworker.0 00000100:00100000:3.0:1788620199.785627:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620199.785627:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620199.785647:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061782912:0@lo:400:kworker.0 00000100:00100000:0.0:1788620199.786350:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782656 00000100:00100000:0.0:1788620199.786362:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782656 00000100:00100000:0.0:1788620199.786414:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788620199.786425:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061782656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.789464:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061783040:0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.789946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620199.790017:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782528 00000100:00100000:2.0:1788620199.790028:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782528 00000100:00100000:2.0:1788620199.790086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788620199.790096:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061782528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.790154:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061782528:12345-0@lo:400:kworker.0 Request processed in 59us (4531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620199.790162:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788620199.790212:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783040 00000100:00100000:2.0:1788620199.790216:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783040 00000100:00100000:2.0:1788620199.790357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788620199.790366:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061783040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.790401:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061783040:12345-0@lo:400:kworker.0 Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620199.790408:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788620199.790427:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620199.790461:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061782528:0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.790476:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061783040:0@lo:400:kworker.0 00000100:00100000:3.0:1788620199.791347:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061783168:0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.791358:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620199.791399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620199.791399:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788620199.791415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061782784:0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.791444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620199.791464:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782912 00000100:00100000:1.0:1788620199.791464:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061783296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620199.791470:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061782784 00000100:00100000:3.0:1788620199.791472:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782912 00000100:00100000:2.0:1788620199.791478:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061782784 00000100:00100000:1.0:1788620199.791485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620199.791504:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783168 00000100:00100000:1.0:1788620199.791507:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783168 00000100:00100000:1.0:1788620199.791538:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620199.791544:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061783168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.791572:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061783168:12345-0@lo:400:kworker.0 Request processed in 29us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620199.791577:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620199.791599:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783296 00000100:00100000:1.0:1788620199.791602:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783296 00000100:00100000:1.0:1788620199.791625:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620199.791632:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061783296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788620199.791657:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620199.791693:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061783296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620199.791699:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788620199.791732:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084f100 x1875504061783296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620199.791750:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061783296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620199.791811:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061782656:12345-0@lo:400:kworker.0 Request processed in 5386us (6188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620199.791955:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788620199.791964:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061782784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620199.791990:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788620199.792015:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061782784:12345-0@lo:400:kworker.0 Request processed in 51us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620199.792024:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788620199.792046:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788620199.792050:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620199.792073:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061782784:0@lo:400:kworker.0 00000100:00080000:2.0:1788620199.792204:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620199.792209:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788620199.792218:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061782912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620199.792279:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061782912:12345-0@lo:400:kworker.0 Request processed in 62us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620199.792285:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788620199.792353:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061782656:0@lo:400:kworker.0 00010000:00080000:3.0:1788620199.792366:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675a1b480 x1875504061783168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620199.792376:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061783168:0@lo:400:kworker.0 00010000:00080000:2.0:1788620199.792951:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675a19c00 x1875504061782912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620199.792962:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061782912:0@lo:400:kworker.0 00010000:00010000:1.0:1788620200.239639:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620200.301543:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620200.301566:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061783424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620200.301636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620200.301809:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783424 00000100:00100000:0.0:1788620200.301818:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783424 00000100:00100000:0.0:1788620200.301869:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620200.301887:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061783424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620200.301921:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620200.301964:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061783424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620200.301971:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788620200.307153:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084c380 x1875504061783424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620200.307180:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061783424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788620201.257744:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620202.284922:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620203.304454:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620204.329034:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620204.362396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620204.362471:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620204.362855:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974720 00000100:00100000:2.0:1788620204.362887:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974720 00000100:00100000:2.0:1788620204.362949:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 201 00000100:00100000:2.0:1788620204.362960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044974720:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620204.363188:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2356:x1875504044974720:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 229us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620204.363198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 201 00000100:00100000:3.0:1788620204.363320:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974848 00000100:00100000:3.0:1788620204.363325:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974848 00000100:00100000:3.0:1788620204.363378:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:3.0:1788620204.363386:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044974848:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620204.363433:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044974848:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 48us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620204.363441:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00080000:2.0:1788620204.365349:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620204.904660:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061783552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620204.904735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620204.904867:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783552 00000100:00100000:0.0:1788620204.904875:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783552 00000100:00100000:0.0:1788620204.904941:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620204.904951:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061783552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620204.904984:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620204.905051:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061783552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620204.905058:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788620204.905127:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084c380 x1875504061783552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620204.905155:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061783552:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788620204.905213:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620204.905611:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061783936:0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.905645:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620204.905670:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788620204.905675:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061783808:0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.905710:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620204.905738:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783936 00000100:00100000:2.0:1788620204.905743:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783936 00000100:00100000:2.0:1788620204.905778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783808 00000100:00100000:2.0:1788620204.905781:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783808 00000100:00100000:2.0:1788620204.905801:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788620204.905808:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061783936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.905846:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061783936:12345-0@lo:400:kworker.0 Request processed in 39us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620204.905852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788620204.905867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788620204.905873:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061783808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.905911:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061783808:12345-0@lo:400:kworker.0 Request processed in 39us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620204.905917:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788620204.905941:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620204.905960:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061783808:0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.905970:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061783936:0@lo:400:kworker.0 00000100:00100000:3.0:1788620204.906022:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061783680:0@lo:400:kworker.0 00000100:00100000:3.0:1788620204.906056:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620204.906090:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061784192:0@lo:400:kworker.0 00000100:00100000:3.0:1788620204.906112:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620204.906127:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620204.906133:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061784064:0@lo:400:kworker.0 00000100:00100000:3.0:1788620204.906155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620204.906228:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061783680 00000100:00100000:2.0:1788620204.906232:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061783680 00000100:00100000:2.0:1788620204.906288:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788620204.906295:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061783680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.906333:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061783680:12345-0@lo:400:kworker.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620204.906339:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788620204.906369:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061783680:0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.906385:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784192 00000100:00100000:2.0:1788620204.906388:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784192 00000100:00100000:2.0:1788620204.906412:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788620204.906418:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061784192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.906450:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061784192:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620204.906455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788620204.906469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620204.906484:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061784192:0@lo:400:kworker.0 00000100:00100000:1.0:1788620204.906599:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784064 00000100:00100000:1.0:1788620204.906603:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784064 00000100:00100000:1.0:1788620204.906654:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788620204.906662:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061784064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620204.906701:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061784064:12345-0@lo:400:kworker.0 Request processed in 41us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620204.906708:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788620204.907008:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788620204.907031:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680b75180 x1875504061784064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620204.907054:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061784064:0@lo:400:kworker.0 00010000:00010000:1.0:1788620205.358195:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620205.416422:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061784320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620205.416507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620205.416557:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784320 00000100:00100000:2.0:1788620205.416566:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784320 00000100:00100000:2.0:1788620205.416613:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788620205.416632:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061784320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620205.416670:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620205.417974:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061784320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1336us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620205.417987:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788620205.423506:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084c700 x1875504061784320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620205.423595:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061784320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620206.379231:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620207.400501:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620208.426568:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788620208.831891:0:10118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:56:46 (1788620206) === 00000100:00100000:0.0:1788620209.360864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620209.360995:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044974976 00000100:00100000:1.0:1788620209.361007:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044974976 00000100:00100000:1.0:1788620209.361066:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 203 00000100:00100000:1.0:1788620209.361076:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:8115:x1875504044974976:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788620209.361095:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620209.361119:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c549a00/0x24857de440bd053f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2201 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.361198:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c549a00/0x24857de440bd053f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2201 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.361210:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c549a00/0x24857de440bd053f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2201 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.361219:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549a00, rc 0) 00000100:00100000:1.0:1788620209.361781:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8115:x1875504044974976:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 703us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.361790:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 203 00000100:00100000:1.0:1788620209.370212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620209.370345:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044975104 00000100:00100000:3.0:1788620209.370356:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044975104 00000100:00100000:3.0:1788620209.370416:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 204 00000100:00100000:3.0:1788620209.370426:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8115:x1875504044975104:12345-192.168.201.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788620209.370732:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8115:x1875504044975104:12345-192.168.201.11@tcp:501:mount.lustre.0 Request processed in 306us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.370740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 204 00000100:00100000:0.0:1788620209.377527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620209.377629:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044975232 00000100:00100000:3.0:1788620209.377640:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044975232 00000100:00100000:3.0:1788620209.377703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 205 00000100:00100000:3.0:1788620209.377714:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8115:x1875504044975232:12345-192.168.201.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788620209.377975:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8115:x1875504044975232:12345-192.168.201.11@tcp:503:mount.lustre.0 Request processed in 261us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.377983:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 205 00000100:00100000:0.0:1788620209.387162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620209.387286:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044975360 00000100:00100000:1.0:1788620209.387297:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044975360 00000100:00100000:1.0:1788620209.387361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 206 00000100:00100000:1.0:1788620209.387373:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8119:x1875504044975360:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620209.387672:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8119:x1875504044975360:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 301us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.387681:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 206 00000100:00100000:1.0:1788620209.409219:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620209.409344:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044975488 00000100:00100000:3.0:1788620209.409367:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044975488 00000100:00100000:3.0:1788620209.409423:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 207 00000100:00100000:3.0:1788620209.409434:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8119:x1875504044975488:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620209.409713:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8119:x1875504044975488:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 280us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.409721:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 207 00000100:00100000:0.0:1788620209.423074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620209.423182:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044975616 00000100:00100000:3.0:1788620209.423192:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044975616 00000100:00100000:3.0:1788620209.423282:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 208 00000100:00100000:3.0:1788620209.423293:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:8115:x1875504044975616:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788620209.423312:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620209.423340:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924e00/0x24857de440bd0546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b222b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620209.423366:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924e00/0x24857de440bd0546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b222b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620209.423376:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924e00/0x24857de440bd0546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b222b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620209.423385:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924e00, rc 0) 00000100:00100000:3.0:1788620209.423445:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:8115:x1875504044975616:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 152us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.423452:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 208 00000100:00100000:0.0:1788620209.431122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620209.431237:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044975744 00000100:00100000:1.0:1788620209.431247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044975744 00000100:00100000:1.0:1788620209.431344:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 209 00000100:00100000:1.0:1788620209.431353:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:8115:x1875504044975744:12345-192.168.201.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788620209.431378:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788620209.431402:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788620209.431411:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788620209.431414:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788620209.431416:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788620209.433169:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:8115:x1875504044975744:12345-192.168.201.11@tcp:256:mount.lustre.0 Request processed in 1807us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.433185:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 209 00000100:00100000:0.0:1788620209.435658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620209.435841:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044975872 00000100:00100000:2.0:1788620209.435852:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044975872 00000100:00100000:2.0:1788620209.435922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 210 00000100:00100000:2.0:1788620209.435942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:8115:x1875504044975872:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788620209.435959:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620209.435977:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2232 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.436004:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.436016:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.436040:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2600, rc 0) 00000100:00100000:2.0:1788620209.436100:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8115:x1875504044975872:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 160us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.436107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 210 00000100:00100000:0.0:1788620209.439500:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620209.439644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976000 00000100:00100000:2.0:1788620209.439655:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976000 00000100:00100000:2.0:1788620209.439754:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 211 00000100:00100000:2.0:1788620209.439765:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8115:x1875504044976000:12345-192.168.201.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788620209.440080:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8115:x1875504044976000:12345-192.168.201.11@tcp:501:mount.lustre.0 Request processed in 316us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.440088:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 211 00000100:00100000:0.0:1788620209.442238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620209.442372:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976128 00000100:00100000:1.0:1788620209.442382:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976128 00000100:00100000:1.0:1788620209.442493:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 212 00000100:00100000:1.0:1788620209.442505:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8115:x1875504044976128:12345-192.168.201.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788620209.442749:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8115:x1875504044976128:12345-192.168.201.11@tcp:503:mount.lustre.0 Request processed in 246us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.442757:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 212 00000100:00100000:0.0:1788620209.445560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620209.446545:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976256 00000100:00100000:2.0:1788620209.446559:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976256 00000100:00100000:2.0:1788620209.446609:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 213 00000100:00100000:2.0:1788620209.446620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8123:x1875504044976256:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788620209.446900:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8123:x1875504044976256:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 281us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.446908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 213 00000100:00100000:0.0:1788620209.455782:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620209.455891:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976384 00000100:00100000:1.0:1788620209.455903:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976384 00000100:00100000:1.0:1788620209.455964:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 214 00000100:00100000:1.0:1788620209.455975:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8123:x1875504044976384:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620209.456241:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:8123:x1875504044976384:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 266us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.456271:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 214 00010000:00010000:2.0:1788620209.457537:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620209.462997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620209.463038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620209.463200:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976896 00000100:00100000:3.0:1788620209.463210:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976896 00000100:00100000:3.0:1788620209.463324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976512 00000100:00100000:3.0:1788620209.463328:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976512 00000100:00100000:3.0:1788620209.463365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:3.0:1788620209.463375:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044976896:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620209.463451:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044976896:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 78us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.463459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:3.0:1788620209.463477:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:3.0:1788620209.463481:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875504044976512:12345-192.168.201.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788620209.463505:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 08800a14-727c-477e-9a55-bbbe86f0530f@192.168.201.11@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788620209.463544:0:5841:0:(genops.c:1385:class_connect()) connect: client 08800a14-727c-477e-9a55-bbbe86f0530f, cookie 0x24857de440bd0554 00000004:00100000:3.0:1788620209.463576:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788620209.463837:0:5841:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620209.463869:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+6:2352:x1875504044976512:12345-192.168.201.11@tcp:38:mount.lustre.0 Request processed in 386us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.463876:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00080000:0.0:1788620209.464063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620209.474851:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620209.475009:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976768 00000100:00100000:3.0:1788620209.475020:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976768 00000100:00100000:3.0:1788620209.475095:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:3.0:1788620209.475107:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+6:8115:x1875504044976768:12345-192.168.201.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788620209.475166:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788620209.475294:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+6:8115:x1875504044976768:12345-192.168.201.11@tcp:41:mount.lustre.0 Request processed in 188us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.475303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00080000:0.0:1788620209.475789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620209.481072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620209.481233:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044976640 00000100:00100000:2.0:1788620209.481244:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044976640 00000100:00100000:2.0:1788620209.481343:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:2.0:1788620209.481354:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08800a14-727c-477e-9a55-bbbe86f0530f+6:0:x1875504044976640:12345-192.168.201.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788620209.481388:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788620209.481470:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08800a14-727c-477e-9a55-bbbe86f0530f+6:0:x1875504044976640:12345-192.168.201.11@tcp:41:mount.lustre.0 Request processed in 117us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.481479:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:1.0:1788620209.483740:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620209.483831:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977024 00000100:00100000:2.0:1788620209.483840:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977024 00000100:00100000:2.0:1788620209.483953:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:2.0:1788620209.483964:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+6:8115:x1875504044977024:12345-192.168.201.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788620209.484049:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+6:8115:x1875504044977024:12345-192.168.201.11@tcp:40:mount.lustre.0 Request processed in 86us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.484056:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:0.0:1788620209.487527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620209.487570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620209.487600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620209.487633:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977152 00000100:00100000:0.0:1788620209.487642:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977152 00000100:00100000:0.0:1788620209.487676:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977280 00000100:00100000:0.0:1788620209.487679:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977280 00000100:00100000:0.0:1788620209.487698:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:0.0:1788620209.487707:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875504044977152:12345-192.168.201.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788620209.487738:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 08800a14-727c-477e-9a55-bbbe86f0530f@192.168.201.11@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1788620209.487773:0:6686:0:(genops.c:1385:class_connect()) connect: client 08800a14-727c-477e-9a55-bbbe86f0530f, cookie 0x24857de440bd055b 00002000:00100000:0.0:1788620209.487784:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08800a14-727c-477e-9a55-bbbe86f0530f/ffffa0d666e97000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788620209.487806:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788620209.488223:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977408 00000100:00100000:1.0:1788620209.488229:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977408 00000100:00100000:1.0:1788620209.488292:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:1.0:1788620209.488301:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08800a14-727c-477e-9a55-bbbe86f0530f+6:8115:x1875504044977408:12345-192.168.201.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788620209.488589:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788620209.488734:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08800a14-727c-477e-9a55-bbbe86f0530f+6:8115:x1875504044977408:12345-192.168.201.11@tcp:33:mount.lustre.0 Request processed in 433us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.488743:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:3.0:1788620209.496739:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:3.0:1788620209.496754:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875504044977280:12345-192.168.201.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788620209.496814:0:7779:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 08800a14-727c-477e-9a55-bbbe86f0530f@192.168.201.11@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788620209.496849:0:7779:0:(genops.c:1385:class_connect()) connect: client 08800a14-727c-477e-9a55-bbbe86f0530f, cookie 0x24857de440bd0562 00002000:00100000:3.0:1788620209.496862:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 08800a14-727c-477e-9a55-bbbe86f0530f/ffffa0d680a2c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788620209.496887:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788620209.497135:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788620209.497184:0:7779:0:(import.c:65:import_set_state_nolock()) ffffa0d680a28000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620209.497293:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+6:2352:x1875504044977280:12345-192.168.201.11@tcp:8:mount.lustre.0 Request processed in 540us (9690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.497301:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00002000:00080000:0.0:1788620209.497619:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788620209.497640:0:6686:0:(import.c:65:import_set_state_nolock()) ffffa0d666e93000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620209.497671:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08800a14-727c-477e-9a55-bbbe86f0530f+6:2352:x1875504044977152:12345-192.168.201.11@tcp:8:mount.lustre.0 Request processed in 9963us (10098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620209.497678:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:3.0:1788620210.024557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061784448:0@lo:400:kworker.0 00000100:00100000:3.0:1788620210.024639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620210.025151:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061784832:0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.025191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620210.025225:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620210.025231:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061784960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620210.025279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620210.025319:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061784576:0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.025347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620210.025366:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620210.025372:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061784704:0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.025394:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620210.025421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784576 00000100:00100000:1.0:1788620210.025429:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784576 00000100:00100000:1.0:1788620210.025472:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784704 00000100:00100000:1.0:1788620210.025476:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784704 00000100:00100000:1.0:1788620210.025507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788620210.025516:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061784576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.025567:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061784576:12345-0@lo:400:kworker.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620210.025575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788620210.025594:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788620210.025600:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061784704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.025627:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061784704:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620210.025633:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788620210.025669:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061784704:0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.025678:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061784576:0@lo:400:kworker.0 00000100:00080000:1.0:1788620210.025724:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620210.025749:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784960 00000100:00100000:1.0:1788620210.025752:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784960 00000100:00100000:1.0:1788620210.025783:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788620210.025789:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061784960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788620210.025806:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620210.025841:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061784960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620210.025847:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788620210.025864:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788620210.025881:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084e680 x1875504061784960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620210.025898:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061784960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620210.025928:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784832 00000100:00100000:1.0:1788620210.025931:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784832 00000100:00100000:1.0:1788620210.025964:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788620210.025971:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061784832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.026006:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061784832:12345-0@lo:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620210.026012:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788620210.026025:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788620210.026041:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680b77800 x1875504061784832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620210.026050:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061784832:0@lo:400:kworker.0 00000100:00100000:1.0:1788620210.026069:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061784448 00000100:00100000:1.0:1788620210.026072:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061784448 00000100:00100000:1.0:1788620210.026106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788620210.026112:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061784448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620210.029613:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788620210.029642:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061785088:0@lo:400:kworker.0 00000100:00100000:2.0:1788620210.030052:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620210.030097:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785088 00000100:00100000:2.0:1788620210.030103:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785088 00000100:00100000:2.0:1788620210.030166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788620210.030175:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061785088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620210.030220:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061785088:12345-0@lo:400:kworker.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620210.030225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788620210.030275:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061785088:0@lo:400:kworker.0 00000100:00080000:2.0:1788620210.030729:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620210.033152:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061784448:12345-0@lo:400:kworker.0 Request processed in 7011us (8484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620210.033168:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788620210.034742:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061784448:0@lo:400:kworker.0 00010000:00010000:1.0:1788620210.472758:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620210.544727:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061785216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620210.544797:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620210.548526:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785216 00000100:00100000:1.0:1788620210.548543:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785216 00000100:00100000:1.0:1788620210.548597:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788620210.548607:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061785216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620210.548633:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620210.549672:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061785216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1062us (4869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620210.549683:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788620210.549790:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d68084e680 x1875504061785216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620210.549812:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061785216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788620211.496619:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620212.522170:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788620213.163438:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08800a14-727c-477e-9a55-bbbe86f0530f 00010000:00010000:1.0:1788620213.544500:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788620213.688153:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08800a14-727c-477e-9a55-bbbe86f0530f 00000001:00100000:1.0:1788620213.737088:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08800a14-727c-477e-9a55-bbbe86f0530f 00010000:00010000:1.0:1788620214.570049:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620214.600556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620214.600627:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977664 00000100:00100000:2.0:1788620214.600648:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977664 00000100:00100000:2.0:1788620214.600720:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:2.0:1788620214.600731:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044977664:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620214.600798:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044977664:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.600805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00080000:3.0:1788620214.600959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620214.601349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620214.601373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620214.601425:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620214.601494:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977792 00000100:00100000:2.0:1788620214.601499:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977792 00000100:00100000:2.0:1788620214.601533:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:2.0:1788620214.601540:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044977792:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620214.601576:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044977792:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.601583:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:0.0:1788620214.601649:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977536 00000100:00100000:0.0:1788620214.601653:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977536 00000100:00100000:0.0:1788620214.601697:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 216 00000100:00100000:0.0:1788620214.601705:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044977536:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620214.601732:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044977536:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.601739:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 216 00000100:00100000:0.0:1788620214.601767:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978048 00000100:00100000:0.0:1788620214.601771:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978048 00000100:00100000:0.0:1788620214.601798:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:0.0:1788620214.601805:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044978048:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620214.601832:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044978048:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.601839:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00080000:3.0:1788620214.602029:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620214.602033:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620214.603966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620214.604065:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044977920 00000100:00100000:3.0:1788620214.604083:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044977920 00000100:00100000:3.0:1788620214.604149:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00100000:3.0:1788620214.604160:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044977920:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620214.604229:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044977920:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.604236:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00080000:2.0:1788620214.604431:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620215.145175:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061785600:0@lo:400:kworker.0 00000100:00100000:0.0:1788620215.145283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620215.145340:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620215.145347:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061785728:0@lo:400:kworker.0 00000100:00100000:0.0:1788620215.145370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620215.145400:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785728 00000100:00100000:0.0:1788620215.145408:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785728 00000100:00100000:0.0:1788620215.145457:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620215.145465:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061785728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620215.145510:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061785728:12345-0@lo:400:kworker.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620215.145517:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788620215.145553:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807dd880 x1875504061785728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620215.145578:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061785728:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.145676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061785344:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.145708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620215.145732:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061785856:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.145750:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620215.145767:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788620215.145771:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061785472:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.145788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620215.145801:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061785984:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.145839:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620215.145863:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785344 00000100:00100000:1.0:1788620215.145866:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785344 00000100:00100000:1.0:1788620215.145890:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788620215.145896:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061785344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.145924:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061785344:12345-0@lo:400:kworker.0 Request processed in 28us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620215.145931:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788620215.145956:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785600 00000100:00100000:1.0:1788620215.145959:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785600 00000100:00100000:1.0:1788620215.145980:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785856 00000100:00100000:1.0:1788620215.145982:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785856 00000100:00100000:1.0:1788620215.145992:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785472 00000100:00100000:1.0:1788620215.145994:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785472 00000100:00100000:1.0:1788620215.146004:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788620215.146010:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061785600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.146037:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061785600:12345-0@lo:400:kworker.0 Request processed in 28us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620215.146055:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788620215.146067:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620215.146073:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061785856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.146095:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061785856:12345-0@lo:400:kworker.0 Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620215.146100:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620215.146109:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788620215.146113:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061785472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.146132:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061785472:12345-0@lo:400:kworker.0 Request processed in 19us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620215.146142:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788620215.146160:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061785984 00000100:00100000:1.0:1788620215.146163:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061785984 00000100:00100000:1.0:1788620215.146183:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788620215.146189:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061785984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.146223:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061785984:12345-0@lo:400:kworker.0 Request processed in 34us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620215.146229:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788620215.146279:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061785472:0@lo:400:kworker.0 00010000:00080000:1.0:1788620215.146289:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807ddc00 x1875504061785984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620215.146297:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061785984:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.146304:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061785344:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.146311:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061785856:0@lo:400:kworker.0 00000100:00100000:1.0:1788620215.146335:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061785600:0@lo:400:kworker.0 00000100:00080000:2.0:1788620215.146466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620215.146471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788620215.146472:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620215.146764:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620215.146775:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061786112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620215.146805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620215.146979:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061786112 00000100:00100000:2.0:1788620215.146983:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061786112 00000100:00100000:2.0:1788620215.147020:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788620215.147027:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061786112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620215.147067:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620215.147111:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061786112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620215.147117:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788620215.147392:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d645181880 x1875504061786112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620215.147407:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061786112:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788620215.459446:0:10315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788620215.594190:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620215.658580:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620215.658605:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061786240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620215.658675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620215.664902:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061786240 00000100:00100000:2.0:1788620215.664917:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061786240 00000100:00100000:2.0:1788620215.664988:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788620215.664998:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061786240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620215.665048:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620215.665139:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061786240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (6463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620215.665146:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788620215.665387:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d645180e00 x1875504061786240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620215.665408:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d645180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061786240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788620216.616575:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620217.644507:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620218.664878:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620219.689280:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620219.718342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620219.718386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620219.718414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620219.718439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620219.718475:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620219.718500:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978432 00000100:00100000:0.0:1788620219.718508:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978432 00000100:00100000:0.0:1788620219.718556:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978304 00000100:00100000:0.0:1788620219.718558:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978304 00000100:00100000:0.0:1788620219.718577:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:0.0:1788620219.718585:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044978432:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620219.718651:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044978432:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 67us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620219.718658:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:0.0:1788620219.718674:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:0.0:1788620219.718680:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044978304:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620219.718718:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504044978304:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 38us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620219.718725:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:0.0:1788620219.718742:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978688 00000100:00100000:0.0:1788620219.718745:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978688 00000100:00100000:0.0:1788620219.718779:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978560 00000100:00100000:0.0:1788620219.718782:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978560 00000100:00100000:0.0:1788620219.718797:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:0.0:1788620219.718803:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044978688:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620219.718826:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044978688:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620219.718832:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:0.0:1788620219.718842:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:0.0:1788620219.718847:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044978560:12345-192.168.201.11@tcp:400:kworker.0 00000100:00080000:1.0:1788620219.719273:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620219.719278:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788620219.719280:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620219.720376:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978176 00000100:00100000:2.0:1788620219.720387:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978176 00000100:00100000:2.0:1788620219.720482:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 218 00000100:00100000:2.0:1788620219.720491:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044978176:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620219.720545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044978176:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 56us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620219.720552:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 218 00000100:00100000:0.0:1788620219.723137:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044978560:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 4275us (4647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620219.723154:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:2.0:1788620220.264556:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061786624:0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.264644:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061786496:0@lo:400:kworker.0 00000100:00100000:2.0:1788620220.264645:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620220.264739:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061786368:0@lo:400:kworker.0 00000100:00100000:1.0:1788620220.264789:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061786624 00000100:00100000:1.0:1788620220.264797:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061786624 00000100:00100000:1.0:1788620220.264856:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788620220.264866:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061786624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.265695:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620220.265747:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061787008:0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.265779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620220.265852:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787008 00000100:00100000:0.0:1788620220.265857:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787008 00000100:00100000:0.0:1788620220.265894:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788620220.265903:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061787008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.265971:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061787008:12345-0@lo:400:kworker.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620220.265979:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788620220.266020:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807dd500 x1875504061787008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620220.266035:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061787008:0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.266085:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061786496 00000100:00100000:0.0:1788620220.266089:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061786496 00000100:00100000:0.0:1788620220.266113:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788620220.266120:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061786496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.266156:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061786496:12345-0@lo:400:kworker.0 Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620220.266162:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788620220.266179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620220.266183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620220.266202:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061786496:0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.266270:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061786752:0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.266312:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620220.266337:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620220.266342:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061787136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620220.266379:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620220.266406:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787136 00000100:00100000:0.0:1788620220.266409:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787136 00000100:00100000:0.0:1788620220.266433:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788620220.266439:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061787136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620220.266475:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620220.266514:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061787136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620220.266520:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788620220.266544:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d664e0a300 x1875504061787136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620220.266558:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061787136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620220.266584:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061786752 00000100:00100000:0.0:1788620220.266588:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061786752 00000100:00100000:0.0:1788620220.266616:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788620220.266622:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061786752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620220.266656:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061786752:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620220.266663:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788620220.266680:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788620220.266694:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807dc000 x1875504061786752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620220.266704:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061786752:0@lo:400:kworker.0 00000100:00100000:3.0:1788620220.269978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620220.270051:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061786880:0@lo:400:kworker.0 00000100:00100000:3.0:1788620220.270089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620220.270137:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061786880 00000100:00100000:3.0:1788620220.270144:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061786880 00000100:00100000:3.0:1788620220.270198:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788620220.270207:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061786880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620220.270278:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061786880:12345-0@lo:400:kworker.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620220.270286:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788620220.270310:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620220.270353:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061786880:0@lo:400:kworker.0 00000100:00100000:2.0:1788620220.270499:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061786368 00000100:00100000:2.0:1788620220.270504:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061786368 00000100:00100000:2.0:1788620220.270539:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788620220.270547:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061786368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620220.270584:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061786368:12345-0@lo:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620220.270590:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788620220.270723:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061786624:12345-0@lo:400:kworker.0 Request processed in 5858us (6076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620220.270730:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788620220.270877:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061786624:0@lo:400:kworker.0 00000100:00100000:3.0:1788620220.271155:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061786368:0@lo:400:kworker.0 00010000:00010000:0.0:1788620220.716463:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620220.779470:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061787264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620220.779544:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620220.779741:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787264 00000100:00100000:0.0:1788620220.779750:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787264 00000100:00100000:0.0:1788620220.779806:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788620220.779816:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061787264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620220.779851:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620220.779901:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061787264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620220.779917:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788620220.779982:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11d880 x1875504061787264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620220.780000:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061787264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620221.740750:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620222.763176:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620223.789414:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620224.808457:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620224.839963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620224.840001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620224.840031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620224.840052:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620224.840090:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620224.840122:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979072 00000100:00100000:3.0:1788620224.840132:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979072 00000100:00100000:3.0:1788620224.840187:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978944 00000100:00100000:3.0:1788620224.840191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978944 00000100:00100000:3.0:1788620224.840216:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:3.0:1788620224.840227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979072:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620224.840319:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979072:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 94us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620224.840327:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:3.0:1788620224.840342:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:3.0:1788620224.840348:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044978944:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620224.840368:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044978944:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 20us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620224.840373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:3.0:1788620224.840393:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979328 00000100:00100000:3.0:1788620224.840397:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979328 00000100:00100000:3.0:1788620224.840421:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979200 00000100:00100000:3.0:1788620224.840424:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979200 00000100:00100000:3.0:1788620224.840440:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:3.0:1788620224.840454:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979328:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620224.840478:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979328:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620224.840484:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:3.0:1788620224.840494:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:3.0:1788620224.840499:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979200:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620224.840517:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979200:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 19us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620224.840523:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00080000:3.0:1788620224.840544:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620224.840549:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620224.840551:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620224.841335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044978816 00000100:00100000:2.0:1788620224.841345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044978816 00000100:00100000:2.0:1788620224.841389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 220 00000100:00100000:2.0:1788620224.841398:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044978816:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620224.841446:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044978816:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 49us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620224.841453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 220 00000100:00100000:0.0:1788620225.384508:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061787392:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.384581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620225.384626:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061787904:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.384648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620225.384682:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788620225.384688:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061787520:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.384706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620225.384719:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061788032:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.384749:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620225.384775:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061787648:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.384794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620225.384809:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620225.384813:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061787776:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.384829:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620225.384854:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787392 00000100:00100000:0.0:1788620225.384871:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787392 00000100:00100000:0.0:1788620225.384914:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788620225.384922:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061787392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.384964:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061787392:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620225.384978:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788620225.385007:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787904 00000100:00100000:0.0:1788620225.385010:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787904 00000100:00100000:0.0:1788620225.385051:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787520 00000100:00100000:0.0:1788620225.385054:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787520 00000100:00100000:0.0:1788620225.385064:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787648 00000100:00100000:0.0:1788620225.385066:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787648 00000100:00100000:0.0:1788620225.385077:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788620225.385083:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061787904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385110:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061787904:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620225.385116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788620225.385126:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788620225.385131:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061787520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385150:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061787520:12345-0@lo:400:kworker.0 Request processed in 19us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620225.385155:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788620225.385163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788620225.385168:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061787648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385195:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061787648:12345-0@lo:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620225.385200:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788620225.385219:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788032 00000100:00100000:0.0:1788620225.385222:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788032 00000100:00100000:0.0:1788620225.385246:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061787776 00000100:00100000:0.0:1788620225.385270:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061787776 00000100:00100000:0.0:1788620225.385289:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788620225.385300:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061788032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385327:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061788032:12345-0@lo:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620225.385333:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788620225.385343:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788620225.385348:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061787776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385367:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061787776:12345-0@lo:400:kworker.0 Request processed in 19us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620225.385372:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788620225.385395:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620225.385399:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620225.385402:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788620225.385435:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11e680 x1875504061787776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620225.385450:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061787776:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385462:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061787648:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385494:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061787520:0@lo:400:kworker.0 00010000:00080000:0.0:1788620225.385503:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11f100 x1875504061788032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620225.385512:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061788032:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385519:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061787392:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.385526:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061787904:0@lo:400:kworker.0 00000100:00100000:0.0:1788620225.386316:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620225.386334:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061788160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620225.386370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620225.389487:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788160 00000100:00100000:2.0:1788620225.389504:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788160 00000100:00100000:2.0:1788620225.391199:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788620225.391219:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061788160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620225.391283:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620225.391376:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061788160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (5004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620225.391392:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788620225.392174:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807df100 x1875504061788160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620225.392198:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061788160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788620225.835707:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620225.896521:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620225.896545:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061788288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620225.896616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620225.896769:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788288 00000100:00100000:0.0:1788620225.896778:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788288 00000100:00100000:0.0:1788620225.896827:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788620225.896838:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061788288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620225.896883:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620225.896936:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061788288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620225.896944:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788620225.897016:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11d880 x1875504061788288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620225.897106:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061788288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788620226.858673:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620227.883045:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620228.905426:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620229.929134:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620229.960928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620229.961023:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979584 00000100:00100000:1.0:1788620229.961041:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979584 00000100:00100000:1.0:1788620229.961119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 74 00000100:00100000:1.0:1788620229.961149:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044979584:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620229.961233:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044979584:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620229.961242:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 74 00000100:00080000:3.0:1788620229.961349:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620229.963750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620229.963843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620229.964012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979712 00000100:00100000:3.0:1788620229.964022:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979712 00000100:00100000:3.0:1788620229.964099:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:3.0:1788620229.964109:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979712:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620229.964195:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979456 00000100:00100000:1.0:1788620229.964199:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979456 00000100:00100000:1.0:1788620229.964227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 222 00000100:00100000:1.0:1788620229.964234:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044979456:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620229.964682:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044979456:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 446us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620229.964690:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 222 00000100:00100000:3.0:1788620229.964794:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044979712:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 673us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620229.964803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00080000:3.0:1788620229.964826:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620229.966388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620229.966551:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620229.966693:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979840 00000100:00100000:1.0:1788620229.966702:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979840 00000100:00100000:1.0:1788620229.966769:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044979968 00000100:00100000:1.0:1788620229.966780:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044979968 00000100:00100000:0.0:1788620229.967020:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:0.0:1788620229.967033:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2352:x1875504044979840:12345-192.168.201.11@tcp:9:kworker.0 00000020:00000080:0.0:1788620229.967064:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd055b 00000100:00080000:0.0:1788620229.967075:0:6689:0:(import.c:65:import_set_state_nolock()) ffffa0d666e93000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788620229.967115:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788620229.967214:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:1.0:1788620229.967224:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2352:x1875504044979968:12345-192.168.201.11@tcp:9:kworker.0 00000020:00000080:1.0:1788620229.967236:0:7779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0562 00000100:00080000:1.0:1788620229.967242:0:7779:0:(import.c:65:import_set_state_nolock()) ffffa0d680a28000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788620229.967289:0:7779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788620229.968030:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620229.968037:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620229.968425:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08800a14-727c-477e-9a55-bbbe86f0530f+2:2352:x1875504044979968:12345-192.168.201.11@tcp:9:kworker.0 Request processed in 1200us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620229.968680:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08800a14-727c-477e-9a55-bbbe86f0530f+2:2352:x1875504044979840:12345-192.168.201.11@tcp:9:kworker.0 Request processed in 1650us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620229.968690:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 14 00010000:00010000:0.0:1788620229.968721:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620229.968728:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620229.969548:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:0.0:1788620230.504517:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061788544:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.504602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620230.504655:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061789056:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.504681:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620230.504725:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788620230.504731:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061788416:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.504758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620230.504791:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061788928:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.504815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620230.504842:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061788800:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.504868:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620230.504886:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620230.504891:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061788672:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.504914:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620230.504940:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788544 00000100:00100000:0.0:1788620230.504948:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788544 00000100:00100000:0.0:1788620230.504992:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788928 00000100:00100000:0.0:1788620230.504995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788928 00000100:00100000:0.0:1788620230.505014:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788672 00000100:00100000:0.0:1788620230.505017:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788672 00000100:00100000:0.0:1788620230.505033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788620230.505041:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061788544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505093:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061788544:12345-0@lo:400:kworker.0 Request processed in 52us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620230.505101:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788620230.505117:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788620230.505124:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061788928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505164:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061788928:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620230.505170:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788620230.505182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788620230.505196:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061788672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505226:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061788672:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620230.505232:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788620230.505275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788416 00000100:00100000:0.0:1788620230.505278:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788416 00000100:00100000:0.0:1788620230.505305:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788620230.505312:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061788416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505341:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061788416:12345-0@lo:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620230.505347:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788620230.505378:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789056 00000100:00100000:0.0:1788620230.505381:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789056 00000100:00100000:0.0:1788620230.505405:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061788800 00000100:00100000:0.0:1788620230.505408:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061788800 00000100:00100000:0.0:1788620230.505427:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788620230.505433:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061789056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505464:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061789056:12345-0@lo:400:kworker.0 Request processed in 30us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620230.505470:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788620230.505480:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788620230.505486:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d648533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061788800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505535:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d648533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061788800:12345-0@lo:400:kworker.0 Request processed in 49us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620230.505540:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788620230.505719:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061788672:0@lo:400:kworker.0 00010000:00080000:0.0:1788620230.505734:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11e680 x1875504061788800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620230.505743:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061788800:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505770:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061788416:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505792:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061788928:0@lo:400:kworker.0 00000100:00100000:0.0:1788620230.505800:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061788544:0@lo:400:kworker.0 00010000:00080000:0.0:1788620230.505810:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11df80 x1875504061789056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620230.505818:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061789056:0@lo:400:kworker.0 00000100:00080000:3.0:1788620230.506099:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620230.506105:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620230.506107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620230.506199:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061789184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620230.506235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620230.506351:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789184 00000100:00100000:3.0:1788620230.506356:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789184 00000100:00100000:3.0:1788620230.506494:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788620230.506499:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061789184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620230.506523:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620230.506553:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061789184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620230.506558:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788620230.506625:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807df800 x1875504061789184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620230.506653:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061789184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788620230.957147:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620231.018596:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620231.018620:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061789312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620231.018700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620231.019488:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789312 00000100:00100000:3.0:1788620231.019500:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789312 00000100:00100000:3.0:1788620231.019566:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788620231.019576:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061789312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620231.019611:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620231.019674:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061789312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620231.019681:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788620231.019808:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11df80 x1875504061789312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620231.019830:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061789312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788620231.978408:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620233.000925:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620233.252614:0:11014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788620233.648911:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08800a14-727c-477e-9a55-bbbe86f0530f 00000020:00000080:1.0:1788620233.648920:0:6712:0:(genops.c:885:class_export_put()) final put ffffa0d666e97000/08800a14-727c-477e-9a55-bbbe86f0530f 00000020:00000080:2.0:1788620233.649051:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d666e97000/08800a14-727c-477e-9a55-bbbe86f0530f for lustre-OST0000 00000020:00000080:2.0:1788620233.649113:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d666e93000 for lustre-OST0000 00010000:00010000:1.0:1788620234.024732:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788620234.189906:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08800a14-727c-477e-9a55-bbbe86f0530f 00000020:00000080:0.0:1788620234.189916:0:7638:0:(genops.c:885:class_export_put()) final put ffffa0d680a2c000/08800a14-727c-477e-9a55-bbbe86f0530f 00000020:00000080:2.0:1788620234.189979:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680a2c000/08800a14-727c-477e-9a55-bbbe86f0530f for lustre-OST0001 00000020:00000080:2.0:1788620234.190424:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d680a28000 for lustre-OST0001 00010000:00010000:0.0:1788620235.048530:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620235.087178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620235.087247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620235.087308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620235.087352:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980352 00000100:00100000:2.0:1788620235.087363:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980352 00000100:00100000:0.0:1788620235.087388:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980096 00000100:00100000:0.0:1788620235.087394:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980096 00000100:00100000:0.0:1788620235.087446:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 224 00000100:00100000:2.0:1788620235.087447:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980224 00000100:00100000:2.0:1788620235.087453:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980224 00000100:00100000:0.0:1788620235.087459:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504044980096:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620235.087481:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:2.0:1788620235.087491:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504044980352:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620235.087554:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504044980096:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 98us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620235.087563:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 224 00000100:00080000:3.0:1788620235.087564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620235.087602:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 80 00000100:00100000:0.0:1788620235.087610:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044980224:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620235.090414:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504044980224:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 2790us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620235.090428:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504044980352:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 2910us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620235.090431:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 80 00000100:00100000:2.0:1788620235.090444:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:0.0:1788620235.634538:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620235.634561:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061789440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620235.634630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620235.634847:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789440 00000100:00100000:3.0:1788620235.634855:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789440 00000100:00100000:3.0:1788620235.634907:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788620235.634917:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061789440:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620235.634934:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061789696:0@lo:400:kworker.0 00002000:00000024:3.0:1788620235.634958:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788620235.634983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620235.634997:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061789440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620235.635002:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620235.635004:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788620235.635007:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061789824:0@lo:400:kworker.0 00000100:00080000:3.0:1788620235.635024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620235.635028:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620235.635033:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061789952:0@lo:400:kworker.0 00000100:00100000:3.0:1788620235.635059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620235.635067:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789696 00000100:00100000:2.0:1788620235.635070:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789696 00000100:00100000:3.0:1788620235.635076:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788620235.635081:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061789568:0@lo:400:kworker.0 00000100:00100000:2.0:1788620235.635094:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789824 00000100:00100000:2.0:1788620235.635096:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789824 00000100:00100000:3.0:1788620235.635106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620235.635122:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788620235.635125:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061790080:0@lo:400:kworker.0 00000100:00100000:2.0:1788620235.635128:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061789696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620235.635145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620235.635169:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061789696:12345-0@lo:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620235.635176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788620235.635189:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061790080 00000100:00100000:2.0:1788620235.635193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061790080 00000100:00100000:2.0:1788620235.635209:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788620235.635215:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061789824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620235.635219:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789952 00000100:00100000:0.0:1788620235.635222:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789952 00000100:00100000:2.0:1788620235.635242:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061789824:12345-0@lo:400:kworker.0 Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620235.635272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788620235.635277:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788620235.635283:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788620235.635284:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061789952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620235.635288:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061790080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620235.635318:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061790080:12345-0@lo:400:kworker.0 Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620235.635324:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788620235.646647:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061789952:12345-0@lo:400:kworker.0 Request processed in 11353us (11576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620235.646662:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788620235.646726:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061789568 00000100:00100000:0.0:1788620235.646736:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061789568 00000100:00100000:0.0:1788620235.646777:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788620235.646786:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061789568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620235.646852:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061789568:12345-0@lo:400:kworker.0 Request processed in 67us (11744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620235.646859:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00080000:0.0:1788620235.646963:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11d180 x1875504061789440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620235.646984:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061789440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620235.647141:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061790080:0@lo:400:kworker.0 00010000:00080000:2.0:1788620235.647159:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807ded80 x1875504061789952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620235.647168:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061789952:0@lo:400:kworker.0 00000100:00100000:2.0:1788620235.647188:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061789568:0@lo:400:kworker.0 00000100:00080000:2.0:1788620235.647204:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620235.647209:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620235.647230:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061789824:0@lo:400:kworker.0 00000100:00100000:2.0:1788620235.647242:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061789696:0@lo:400:kworker.0 00010000:00010000:2.0:1788620236.072756:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620236.136388:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620236.136412:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6436a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061790208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620236.136482:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620236.136545:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061790208 00000100:00100000:1.0:1788620236.136553:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061790208 00000100:00100000:1.0:1788620236.136614:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788620236.136623:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061790208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620236.136672:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620236.136743:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061790208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620236.136750:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788620236.136791:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6436a9180 x1875504061790208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620236.136810:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6436a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061790208:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788620236.604279:0:11166:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe861d8b30 20000000:00000080:1.0:1788620236.604299:0:11166:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0d680b71000 uarg=0000000000000000 20000000:01000000:1.0:1788620236.604920:0:11166:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788620236.604926:0:11166:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788620236.604932:0:11166:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788620236.606170:0:11167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788620236.606700:0:11166:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788620236.620001:0:11166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788620236.620035:0:11166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620057:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620066:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0515 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620073:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0523 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620079:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd0531 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620084:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620092:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620135:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.620151:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 12 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.620164:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790336:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620236.622927:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0531 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.622947:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0531 expref: 18 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.622961:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790464:0@lo:104: 00000100:00100000:2.0:1788620236.623024:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788620236.623290:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0523 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.623300:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0523 expref: 18 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.623309:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790592:0@lo:104: 00000100:00100000:2.0:1788620236.623368:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620236.629995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620236.630170:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980480 00000100:00100000:3.0:1788620236.630182:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980480 00010000:00010000:3.0:1788620236.630223:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 13 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620236.630296:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 25 00000100:00100000:3.0:1788620236.630308:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044980480:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620236.630323:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620236.630331:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 13 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620236.630348:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 13 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620236.630371:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620236.630446:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044980480:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 141us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620236.630461:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 25 00010000:00010000:2.0:1788620236.632727:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd0515 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.632746:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd0515 expref: 18 pid: 5832 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.632760:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790720:0@lo:104: 00000100:00100000:2.0:1788620236.632815:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620236.632868:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061790464 00000100:00100000:1.0:1788620236.632876:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061790464 00000100:00100000:1.0:1788620236.632917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061790592 00000100:00100000:1.0:1788620236.632920:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061790592 00000100:00100000:1.0:1788620236.632935:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788620236.632944:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:11166:x1875504061790464:12345-0@lo:104: 00010000:00010000:1.0:1788620236.632958:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620236.633011:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620236.633017:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+4:11166:x1875504061790464:12345-0@lo:104: Request processed in 75us (9994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620236.633025:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788620236.633042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620236.633064:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:11166:x1875504061790592:12345-0@lo:104: 00010000:00010000:1.0:1788620236.633072:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620236.633107:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788620236.633112:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:11166:x1875504061790592:12345-0@lo:104: Request processed in 49us (9744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620236.633118:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788620236.634443:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620236.634454:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634465:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925400 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620236.634470:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634480:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620236.634487:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620236.634492:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788620236.634547:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634553:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620236.634579:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634586:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd0531 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0538 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634602:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620236.634616:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634622:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3200 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620236.634625:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634632:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620236.634637:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620236.634642:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788620236.634656:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634662:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620236.634688:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634695:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3200/0x24857de440bd0523 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd052a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.634705:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620236.634706:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620236.634708:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620236.634726:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620236.634743:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061790848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620236.634795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620236.634858:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061790976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620236.634891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620236.634929:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061790848 00000100:00100000:0.0:1788620236.634938:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061790848 00010000:00010000:0.0:1788620236.634968:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0531 expref: 19 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620236.634993:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061790976 00000100:00100000:0.0:1788620236.634996:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061790976 00010000:00010000:0.0:1788620236.635008:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0523 expref: 20 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620236.635023:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620236.635033:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+20:3311:x1875504061790848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620236.635045:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620236.635050:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0531 expref: 20 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.635061:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0531 expref: 20 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.635080:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620236.635116:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+20:3311:x1875504061790848:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620236.635123:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620236.635141:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788620236.635148:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061790976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620236.635156:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620236.635160:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0523 expref: 19 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.635179:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0523 expref: 19 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.635207:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620236.635236:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061790976:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620236.635242:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788620236.635311:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061790976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620236.635349:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061790848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620236.639613:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.639635:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 12 pid: 5832 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.641816:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061791104:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620236.641922:0:11166:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f780 going to sleep for 11 seconds 00010000:00010000:2.0:1788620236.641954:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2600/0x24857de440bd054d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2232 expref: 12 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.641970:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790336:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620236.641985:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924a00/0x24857de440bd0538 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0531 expref: 18 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.641995:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790464:0@lo:104: 00010000:00010000:2.0:1788620236.642006:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2200/0x24857de440bd052a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0523 expref: 17 pid: 5833 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.642014:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790592:0@lo:104: 00000100:00100000:1.0:1788620236.645528:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061790720 00000100:00100000:1.0:1788620236.645546:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061790720 00000100:00100000:1.0:1788620236.645619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620236.645631:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:11166:x1875504061790720:12345-0@lo:104: 00010000:00010000:1.0:1788620236.645951:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.646126:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061790720:0@lo:104: 00000100:00100000:2.0:1788620236.646139:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1875504061791104:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620236.646173:0:11166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620236.646212:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620236.646220:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+3:11166:x1875504061790720:12345-0@lo:104: Request processed in 592us (13404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620236.646228:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788620236.647834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620236.647955:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980608 00000100:00100000:2.0:1788620236.647965:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980608 00010000:00010000:2.0:1788620236.648006:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 12 pid: 5832 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620236.648048:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00100000:2.0:1788620236.648057:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:2355:x1875504044980608:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620236.648086:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620236.648092:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 12 pid: 5832 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.648103:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 12 pid: 5832 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.648122:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924200/0x24857de440bd050e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21fa expref: 12 pid: 5832 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620236.648138:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620236.648197:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:2355:x1875504044980608:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 140us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620236.648204:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 28 00010000:00010000:0.0:1788620236.648496:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620236.648505:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.648513:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548e00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620236.648517:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.648525:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620236.648532:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620236.648538:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788620236.648576:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.648589:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620236.648628:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.648635:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd0515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd051c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620236.648677:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620236.648694:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061791232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620236.648737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788620236.648934:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620236.648937:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620236.648939:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620236.648951:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061791232 00000100:00100000:0.0:1788620236.648957:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061791232 00010000:00010000:0.0:1788620236.648979:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0515 expref: 17 pid: 5832 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620236.649008:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620236.649016:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3308:x1875504061791232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620236.649025:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620236.649029:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd0515 expref: 17 pid: 5832 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649039:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd0515 expref: 17 pid: 5832 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649049:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2400/0x24857de440bd051c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd0515 expref: 17 pid: 5832 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649060:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649068:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649093:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649100:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649107:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649114:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649119:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620236.649124:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.649130:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620236.667911:0:11166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620236.667931:0:11166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.671428:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.671450:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe3800/0x24857de440bd0569 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620236.671473:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620236.671616:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3308:x1875504061791232:12345-0@lo:103:ldlm_bl.0 Request processed in 22597us (22874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620236.671627:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788620236.675855:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061791232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620237.096628:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620237.958199:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620237.958299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980736 00000100:00100000:2.0:1788620237.958310:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980736 00000100:00100000:2.0:1788620237.958368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 226 00000100:00100000:2.0:1788620237.958378:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:5593:x1875504044980736:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620237.958396:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620237.958415:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b225c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620237.958456:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620237.958469:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620237.958479:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2200, rc 0) 00000100:00100000:2.0:1788620237.958543:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044980736:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 166us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620237.958551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 226 00000100:00100000:0.0:1788620237.964691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620237.965042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980864 00000100:00100000:2.0:1788620237.965054:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980864 00000100:00100000:2.0:1788620237.965111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 227 00000100:00100000:2.0:1788620237.965121:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044980864:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620237.965515:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044980864:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 394us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620237.965524:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 227 00000100:00100000:2.0:1788620237.968864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620237.969032:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044980992 00000100:00100000:3.0:1788620237.969042:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044980992 00000100:00100000:3.0:1788620237.969097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 228 00000100:00100000:3.0:1788620237.969108:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044980992:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620237.977925:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044980992:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 Request processed in 8806us (9059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620237.977938:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 228 00000100:00100000:3.0:1788620237.982195:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620237.982301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044981120 00000100:00100000:0.0:1788620237.982311:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044981120 00000100:00100000:0.0:1788620237.982365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 229 00000100:00100000:0.0:1788620237.982375:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044981120:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620237.982392:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620237.982409:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2263 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620237.982443:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620237.982454:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620237.982464:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518e00, rc 0) 00000100:00100000:0.0:1788620237.982519:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044981120:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 146us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620237.982526:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 229 00000100:00100000:3.0:1788620237.988041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620237.988327:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044981248 00000100:00100000:1.0:1788620237.988340:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044981248 00000100:00100000:1.0:1788620237.988396:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 230 00000100:00100000:1.0:1788620237.988407:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044981248:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620237.988724:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044981248:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 318us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620237.988732:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 230 00000100:00100000:1.0:1788620238.010505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620238.010571:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044981376 00000100:00100000:3.0:1788620238.010584:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044981376 00000100:00100000:3.0:1788620238.010638:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 231 00000100:00100000:3.0:1788620238.010658:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044981376:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620238.010886:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044981376:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 Request processed in 229us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620238.010894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 231 00010000:00010000:0.0:1788620238.120433:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788620238.251337:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620238.251345:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d675d13000 from 7 10000000:01000000:3.0:1788620238.251350:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620238.251396:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620238.251408:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620238.251419:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620238.251445:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675a18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620238.251512:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620238.251609:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680824f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620238.256707:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061791360 00000100:00100000:0.0:1788620238.256721:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061791360 00000100:00100000:0.0:1788620238.256780:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788620238.256791:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061791360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620238.256808:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620238.256826:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd057e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.256852:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd057e expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.256873:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd057e expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.256882:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519c00, rc 0) 00000100:00100000:0.0:1788620238.256972:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061791360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (5459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620238.256979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788620238.257042:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675a18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620238.257069:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.257079:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620238.257152:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.257191:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620238.257223:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d643645e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620238.257362:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061791488 00000100:00100000:0.0:1788620238.257367:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061791488 00000100:00100000:0.0:1788620238.257392:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788620238.257399:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061791488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.257731:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061791488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620238.257739:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788620238.257775:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.257816:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.257855:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620238.257875:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d643645e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620238.257888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061791616 00000100:00100000:0.0:1788620238.257892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061791616 00000100:00100000:0.0:1788620238.257912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788620238.257918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061791616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.258902:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061791616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 979us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620238.258913:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788620238.259727:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788620238.264406:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788620238.264602:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788620238.264627:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620238.264648:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620238.264660:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620238.264668:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788620238.264671:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d680c0a000 from 7 10000000:01000000:2.0:1788620238.264673:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788620238.264708:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620238.264716:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620238.264741:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620238.264765:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620238.264837:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620238.264876:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650712240 going to sleep for 11 seconds 00000100:00100000:0.0:1788620238.265005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061791744 00000100:00100000:0.0:1788620238.265013:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061791744 00000100:00100000:0.0:1788620238.265062:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788620238.265073:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061791744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620238.265090:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620238.265105:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd058c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.265130:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd058c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.265141:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd058c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.265150:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518a00, rc 0) 00000100:00100000:0.0:1788620238.265194:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061791744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620238.265208:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788620238.265282:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620238.265296:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.265305:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620238.265359:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.265385:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620238.265401:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d643645cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620238.265414:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061791872 00000100:00100000:0.0:1788620238.265418:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061791872 00000100:00100000:0.0:1788620238.265440:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788620238.265446:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061791872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.265949:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061791872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 501us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620238.265956:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788620238.266031:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061791872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620238.266063:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620238.266103:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620238.266133:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650712240 going to sleep for 11 seconds 00000100:00100000:0.0:1788620238.266272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792000 00000100:00100000:0.0:1788620238.266277:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792000 00000100:00100000:0.0:1788620238.266307:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788620238.266314:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061792000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.266453:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061792000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620238.266459:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788620238.266500:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788620238.267398:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788620238.267689:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788620238.267709:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620238.267719:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.271073:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620238.271088:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788620238.271091:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d649f43000 from 7 10000000:01000000:0.0:1788620238.271105:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620238.271146:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.271155:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.271165:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620238.271190:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.271283:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620238.271332:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620238.271404:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792128 00000100:00100000:3.0:1788620238.271412:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792128 00000100:00100000:3.0:1788620238.271469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788620238.271479:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061792128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620238.271493:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620238.271505:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd059a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620238.271527:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd059a expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620238.271537:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd059a expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620238.271545:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925c00, rc 0) 00000100:00100000:3.0:1788620238.271614:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061792128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620238.271621:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788620238.271954:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620238.271969:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620238.271977:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620238.272044:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.272070:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620238.272110:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620238.272712:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792256 00000100:00100000:3.0:1788620238.272720:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792256 00000100:00100000:3.0:1788620238.272753:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788620238.272760:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061792256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620238.273022:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061792256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620238.273030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788620238.273300:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.273335:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.273378:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620238.273403:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620238.273416:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792384 00000100:00100000:0.0:1788620238.273421:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792384 00000100:00100000:0.0:1788620238.273446:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788620238.273452:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061792384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620238.274730:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061792384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1270us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620238.274741:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788620238.275212:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061792384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788620238.279666:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788620238.279795:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788620238.279816:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620238.279827:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620238.279838:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620239.144926:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620240.170832:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620240.199493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620240.199530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620240.200224:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044981504 00000100:00100000:2.0:1788620240.200238:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044981504 00000100:00100000:2.0:1788620240.200315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 241 00000100:00100000:2.0:1788620240.200326:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044981504:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620240.200395:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044981504:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 71us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620240.200402:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 241 00000100:00100000:2.0:1788620240.200534:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044981632 00000100:00100000:2.0:1788620240.200538:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044981632 00000100:00100000:2.0:1788620240.201346:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 84 00000100:00100000:2.0:1788620240.201355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044981632:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620240.201405:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044981632:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 52us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620240.201419:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 84 00000100:00080000:3.0:1788620240.203401:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620240.203514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620240.206364:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044981760 00000100:00100000:3.0:1788620240.206380:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044981760 00000100:00100000:3.0:1788620240.206467:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 85 00000100:00100000:3.0:1788620240.206478:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044981760:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620240.206577:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044981760:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 100us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620240.206773:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 85 00000100:00080000:2.0:1788620240.207942:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620240.745792:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061792768:0@lo:400:kworker.0 00000100:00100000:3.0:1788620240.745865:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620240.745923:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620240.745929:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061792896:0@lo:400:kworker.0 00000100:00100000:3.0:1788620240.745955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620240.745990:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792768 00000100:00100000:3.0:1788620240.745997:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792768 00000100:00100000:3.0:1788620240.746052:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788620240.746061:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061792768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620240.746111:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061792768:12345-0@lo:400:kworker.0 Request processed in 51us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620240.746119:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788620240.746144:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792896 00000100:00100000:3.0:1788620240.746147:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792896 00000100:00100000:3.0:1788620240.746177:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788620240.746184:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061792896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620240.746214:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061792896:12345-0@lo:400:kworker.0 Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620240.746220:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788620240.746235:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620240.746239:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620240.746296:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675cedc00 x1875504061792896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620240.746310:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061792896:0@lo:400:kworker.0 00000100:00100000:3.0:1788620240.746338:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061792768:0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746440:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061792640:0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620240.746495:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061793152:0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746516:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620240.746550:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788620240.746556:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061792512:0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620240.746618:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061793024:0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620240.746667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792512 00000100:00100000:1.0:1788620240.746671:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792512 00000100:00100000:1.0:1788620240.746697:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788620240.746704:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061792512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746741:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061792512:12345-0@lo:400:kworker.0 Request processed in 38us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620240.746747:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788620240.746773:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061792640 00000100:00100000:1.0:1788620240.746778:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061792640 00000100:00100000:1.0:1788620240.746796:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793024 00000100:00100000:1.0:1788620240.746799:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793024 00000100:00100000:1.0:1788620240.746821:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788620240.746834:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061792640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746866:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061792640:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620240.746872:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788620240.746884:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788620240.746891:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061793024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746918:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061793024:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620240.746924:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788620240.746949:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061792512:0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746959:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061793024:0@lo:400:kworker.0 00000100:00100000:1.0:1788620240.746968:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061792640:0@lo:400:kworker.0 00000100:00100000:3.0:1788620240.747179:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793152 00000100:00100000:3.0:1788620240.747184:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793152 00000100:00100000:3.0:1788620240.747220:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788620240.747228:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061793152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620240.747298:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061793152:12345-0@lo:400:kworker.0 Request processed in 72us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620240.747305:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788620240.747324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620240.747328:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788620240.747386:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d675cec380 x1875504061793152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620240.747396:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061793152:0@lo:400:kworker.0 00000100:00100000:2.0:1788620240.749771:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788620240.749793:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061793280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620240.749855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620240.749906:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793280 00000100:00100000:2.0:1788620240.749915:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793280 00000100:00100000:2.0:1788620240.749962:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788620240.749972:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061793280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620240.750007:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788620240.750053:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061793280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620240.750061:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788620240.750106:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807dea00 x1875504061793280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620240.750123:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061793280:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788620240.867370:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788620241.192824:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620241.256509:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6436ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061793408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620241.256604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620241.259981:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793408 00000100:00100000:3.0:1788620241.259996:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793408 00000100:00100000:2.0:1788620241.261132:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788620241.261170:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061793408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620241.261217:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620241.261349:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061793408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (4761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620241.261357:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788620241.261460:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6436ab100 x1875504061793408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620241.261481:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6436ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061793408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620242.218789:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620243.243664:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620244.264765:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620245.140987:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:57:23 (1788620243) === 00010000:00010000:2.0:1788620245.288492:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620245.325312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.325356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.325392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.325430:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044982016 00000100:00100000:3.0:1788620245.325441:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044982016 00000100:00100000:3.0:1788620245.325494:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044982144 00000100:00100000:3.0:1788620245.325497:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044982144 00000100:00100000:3.0:1788620245.325537:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 89 00000100:00100000:3.0:1788620245.325548:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044982016:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620245.325622:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504044982016:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 76us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620245.325647:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 89 00000100:00100000:3.0:1788620245.325665:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 90 00000100:00100000:3.0:1788620245.325671:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044982144:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620245.325697:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2356:x1875504044982144:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620245.325704:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 90 00000100:00080000:3.0:1788620245.325720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620245.326317:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044981888 00000100:00100000:1.0:1788620245.326324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044981888 00000100:00100000:1.0:1788620245.326354:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 243 00000100:00100000:1.0:1788620245.326360:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044981888:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620245.326393:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044981888:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 34us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620245.326410:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 243 00000100:00100000:3.0:1788620245.431697:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620245.431870:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044982400 00000100:00100000:1.0:1788620245.431882:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044982400 00000100:00100000:1.0:1788620245.431952:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:1.0:1788620245.431964:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:9669:x1875504044982400:12345-192.168.201.11@tcp:700:mkdir.0 00000100:00100000:1.0:1788620245.432077:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:9669:x1875504044982400:12345-192.168.201.11@tcp:700:mkdir.0 Request processed in 114us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620245.432085:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:3.0:1788620245.433601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.433690:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044982272 00000100:00100000:0.0:1788620245.433698:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044982272 00000100:00100000:0.0:1788620245.433753:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:0.0:1788620245.433763:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504044982272:12345-192.168.201.11@tcp:41:mkdir.0 00000004:00000024:0.0:1788620245.433805:0:8736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788620245.433903:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504044982272:12345-192.168.201.11@tcp:41:mkdir.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.433922:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:3.0:1788620245.435332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.435531:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044982656 00000100:00100000:0.0:1788620245.435540:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044982656 00000100:00100000:0.0:1788620245.435600:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:0.0:1788620245.435609:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:9669:x1875504044982656:12345-192.168.201.11@tcp:36:mkdir.0 00010000:00010000:0.0:1788620245.435665:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620245.435694:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0489 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21e5 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.435714:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e000) 00010000:00010000:0.0:1788620245.435724:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620245.436035:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.436049:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.436059:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.436070:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.436077:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.436083:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620245.440467:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788620245.440489:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.440501:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.440509:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.440528:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620245.440533:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.440540:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.440561:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43200) 00010000:00010000:1.0:1788620245.440564:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620245.440569:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.440574:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd05a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620245.440595:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddfd2fd7 reply state 000000003561fd6d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620245.440617:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788620245.440883:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9669:x1875504044982656:12345-192.168.201.11@tcp:36:mkdir.0 Request processed in 5270us (5552us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788620245.440893:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 15 00010000:00010000:0.0:1788620245.443013:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.443043:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.443051:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.443058:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620245.443062:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.443070:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.443086:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0d642f43a00) 00010000:00010000:0.0:1788620245.443089:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620245.443093:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.443099:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620245.453038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.453333:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044982784 00000100:00100000:0.0:1788620245.453343:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044982784 00000100:00100000:0.0:1788620245.453390:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:0.0:1788620245.453398:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:9670:x1875504044982784:12345-192.168.201.11@tcp:101:chmod.0 00010000:00010000:0.0:1788620245.453419:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620245.453442:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b226a expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.453530:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.453542:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.453558:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620245.453615:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788620245.453619:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620245.453667:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.453693:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b226a expref: 8 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.453710:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b226a expref: 7 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.453719:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43900) 00010000:00010000:0.0:1788620245.453722:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620245.453726:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519000, rc 0) 00000100:00100000:0.0:1788620245.453780:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9670:x1875504044982784:12345-192.168.201.11@tcp:101:chmod.0 Request processed in 382us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.453786:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:1.0:1788620245.457372:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.457616:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044983040 00000100:00100000:0.0:1788620245.457627:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044983040 00000100:00100000:0.0:1788620245.457705:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:0.0:1788620245.457715:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9670:x1875504044983040:12345-192.168.201.11@tcp:36:chmod.0 00010000:00010000:0.0:1788620245.457777:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620245.457809:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b226a expref: 7 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.457830:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43900) 00010000:00010000:0.0:1788620245.457843:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620245.457882:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.457895:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.457906:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620245.458196:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fec7331 reply state 00000000b62f410e transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620245.458207:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788620245.458221:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788620245.458578:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:9670:x1875504044983040:12345-192.168.201.11@tcp:36:chmod.0 Request processed in 863us (1215us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788620245.458586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 17 00010000:00010000:2.0:1788620245.461572:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.461588:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.461595:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.461602:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620245.461606:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.461615:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.461635:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43a00) 00010000:00010000:2.0:1788620245.461638:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788620245.461642:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.461648:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd05c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620245.476018:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.476197:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044983168 00000100:00100000:0.0:1788620245.476208:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044983168 00000100:00100000:0.0:1788620245.476344:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:0.0:1788620245.476355:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9671:x1875504044983168:12345-192.168.201.11@tcp:101:chown.0 00010000:00010000:0.0:1788620245.476401:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620245.476425:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2271 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.476495:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.476509:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.476536:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620245.476594:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788620245.476598:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620245.476642:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.476668:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd05cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2271 expref: 9 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.476682:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2271 expref: 8 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.476689:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43900) 00010000:00010000:0.0:1788620245.476692:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620245.476696:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519600, rc 0) 00000100:00100000:0.0:1788620245.476757:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:9671:x1875504044983168:12345-192.168.201.11@tcp:101:chown.0 Request processed in 405us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.476762:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:1.0:1788620245.479376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.479454:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044983296 00000100:00100000:3.0:1788620245.479464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044983296 00000100:00100000:3.0:1788620245.479544:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:3.0:1788620245.479554:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:9671:x1875504044983296:12345-192.168.201.11@tcp:101:chown.0 00010000:00010000:3.0:1788620245.479571:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620245.479587:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd05d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2278 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479641:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479653:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479664:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479703:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479712:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479719:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479806:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd05ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479814:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd05ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479820:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd05ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620245.479855:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788620245.479868:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620245.479894:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd05ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479905:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479912:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479919:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479933:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620245.479938:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479946:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479958:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43900) 00010000:00010000:3.0:1788620245.479962:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620245.479966:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479972:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd05e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479985:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479990:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.479997:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.480002:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620245.480005:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.480010:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.480025:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0d65309e900) 00010000:00010000:3.0:1788620245.480027:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620245.480030:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.480036:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd05e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.480063:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd05d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2278 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.480075:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd05ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2278 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.480083:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620245.480085:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620245.480087:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924600, rc 0) 00000100:00100000:3.0:1788620245.480145:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:9671:x1875504044983296:12345-192.168.201.11@tcp:101:chown.0 Request processed in 592us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620245.480151:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:2.0:1788620245.485084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.485122:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044983552 00000100:00100000:3.0:1788620245.485133:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044983552 00000100:00100000:3.0:1788620245.485227:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:3.0:1788620245.485238:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:9671:x1875504044983552:12345-192.168.201.11@tcp:36:chown.0 00010000:00010000:3.0:1788620245.485321:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620245.485351:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd05ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2278 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.485389:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620245.485400:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620245.485427:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.485440:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.485450:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620245.506527:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000004:00010000:1.0:1788620245.506543:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f54fd3b reply state 0000000070fd88aa transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620245.506550:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000100:00100000:1.0:1788620245.506556:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788620245.506714:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1788620245.506802:0:5839:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788620245.506823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9671:x1875504044983552:12345-192.168.201.11@tcp:36:chown.0 Request processed in 21583us (21743us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788620245.506833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 20 00010000:00010000:0.0:1788620245.506845:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.506854:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.506861:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.506867:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620245.506872:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.506880:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.506896:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d65309e400) 00010000:00010000:0.0:1788620245.506899:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788620245.506904:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.506910:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd05f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620245.522587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620245.522710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044983680 00000100:00100000:1.0:1788620245.522721:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044983680 00000100:00100000:1.0:1788620245.524210:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:1.0:1788620245.524229:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:9672:x1875504044983680:12345-192.168.201.11@tcp:101:touch.500 00010000:00010000:1.0:1788620245.524273:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620245.524295:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd05fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b227f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620245.527676:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3321us 00010000:00010000:1.0:1788620245.545236:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.546355:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.546379:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.546401:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.546408:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.546414:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547539:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547552:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547562:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620245.547648:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788620245.547653:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620245.547751:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547765:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547772:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547789:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547795:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620245.547798:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547805:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547818:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43900) 00010000:00010000:1.0:1788620245.547821:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620245.547826:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547832:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547847:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547854:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547860:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547865:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620245.547869:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547885:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547893:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0d64c7c2800) 00010000:00010000:1.0:1788620245.547895:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620245.547898:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547904:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd060a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547943:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd05fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b227f expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547959:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b227f expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.547966:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:1.0:1788620245.547969:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788620245.547971:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549800, rc 0) 00000100:00100000:1.0:1788620245.548058:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9672:x1875504044983680:12345-192.168.201.11@tcp:101:touch.500 Request processed in 23836us (26154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620245.548067:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:1.0:1788620245.551634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.551725:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044983936 00000100:00100000:0.0:1788620245.551735:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044983936 00000100:00100000:0.0:1788620245.551827:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:0.0:1788620245.551838:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9672:x1875504044983936:12345-192.168.201.11@tcp:101:touch.500 00010000:00010000:0.0:1788620245.551859:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620245.551883:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0618 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2286 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.552601:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.552619:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.552631:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.552685:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.552693:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.552700:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620245.554007:0:8736:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788620245.554668:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd062d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554685:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd062d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554698:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd062d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554737:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554754:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554760:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554766:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620245.554771:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554778:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554791:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:0.0:1788620245.554795:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620245.554800:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554806:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd061f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620245.554819:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008d328c9 reply state 00000000e1a156ad transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620245.554828:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788620245.554864:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0618 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2286 expref: 10 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554878:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd062d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2286 expref: 9 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.554898:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d642f43a00) 00010000:00010000:0.0:1788620245.554901:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620245.554904:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518800, rc 0) 00000100:00100000:0.0:1788620245.555024:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:9672:x1875504044983936:12345-192.168.201.11@tcp:101:touch.500 Request processed in 3187us (3401us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788620245.555042:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 22 00010000:00010000:1.0:1788620245.558706:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.558722:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.558745:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.558751:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620245.558756:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.558765:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.558783:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffffa0d642f43d00) 00010000:00010000:1.0:1788620245.558786:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620245.558790:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.558796:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620245.561461:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.562004:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044984192 00000100:00100000:3.0:1788620245.562016:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044984192 00000100:00100000:3.0:1788620245.562227:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:3.0:1788620245.562238:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:9672:x1875504044984192:12345-192.168.201.11@tcp:36:touch.500 00010000:00010000:3.0:1788620245.562333:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620245.562361:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd062d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2286 expref: 9 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.562380:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d642f43a00) 00010000:00010000:3.0:1788620245.562389:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620245.562428:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.562441:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.562450:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788620245.562589:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfac2828 reply state 00000000efe52fb3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620245.562598:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620245.562689:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:9672:x1875504044984192:12345-192.168.201.11@tcp:36:touch.500 Request processed in 447us (1232us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788620245.562696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:0.0:1788620245.566723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00010000:00010000:1.0:1788620245.566788:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.566800:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.566808:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.566814:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620245.566819:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.566841:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.566868:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:1.0:1788620245.566872:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620245.566877:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.566883:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd063b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620245.567305:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044984320 00000100:00100000:3.0:1788620245.567316:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044984320 00000100:00100000:3.0:1788620245.567365:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:3.0:1788620245.567377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:9672:x1875504044984320:12345-192.168.201.11@tcp:101:touch.500 00010000:00010000:3.0:1788620245.567404:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620245.567422:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b228d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.567480:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b228d expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.567494:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b228d expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.567525:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d65309ed00) 00010000:00010000:3.0:1788620245.567528:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620245.567530:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925800, rc 0) 00000100:00100000:3.0:1788620245.567598:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:9672:x1875504044984320:12345-192.168.201.11@tcp:101:touch.500 Request processed in 223us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620245.567605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:3.0:1788620245.569903:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.570223:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044984448 00000100:00100000:0.0:1788620245.570232:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044984448 00000100:00100000:0.0:1788620245.570442:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:0.0:1788620245.570451:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875504044984448:12345-192.168.201.11@tcp:8:touch.500 00010000:00080000:0.0:1788620245.570485:0:7779:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:0.0:1788620245.570527:0:7779:0:(genops.c:1385:class_connect()) connect: client 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a, cookie 0x24857de440bd0649 00002000:00100000:0.0:1788620245.570540:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a/ffffa0d666e90800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788620245.570566:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788620245.570800:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788620245.570829:0:7779:0:(import.c:65:import_set_state_nolock()) ffffa0d666e94800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620245.570899:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2352:x1875504044984448:12345-192.168.201.11@tcp:8:touch.500 Request processed in 447us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.570907:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:1.0:1788620245.573742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.573812:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044984576 00000100:00100000:3.0:1788620245.573823:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044984576 00000100:00100000:3.0:1788620245.573901:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:3.0:1788620245.573912:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:0:x1875504044984576:12345-192.168.201.11@tcp:2:touch.500 00000100:00080000:0.0:1788620245.574215:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620245.601613:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:0:x1875504044984576:12345-192.168.201.11@tcp:2:touch.500 Request processed in 27693us (27871us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788620245.601626:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 17 00000001:00100000:1.0:1788620245.601697:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000001:00080000:1.0:1788620245.601711:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788620245.606659:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.607403:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044984832 00000100:00100000:3.0:1788620245.607414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044984832 00000100:00100000:3.0:1788620245.607478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:3.0:1788620245.607488:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:9672:x1875504044984832:12345-192.168.201.11@tcp:35:touch.500 00000100:00100000:3.0:1788620245.608349:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:9672:x1875504044984832:12345-192.168.201.11@tcp:35:touch.500 Request processed in 858us (1695us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788620245.608358:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:2.0:1788620245.625890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620245.626047:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044984960 00000100:00100000:1.0:1788620245.626058:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044984960 00000100:00100000:1.0:1788620245.626120:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 25 00000100:00100000:1.0:1788620245.626137:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:9673:x1875504044984960:12345-192.168.201.11@tcp:101:rm.0 00010000:00010000:1.0:1788620245.626162:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620245.626182:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2294 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.626299:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.626313:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.626344:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620245.626405:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788620245.626409:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620245.626454:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.626481:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2294 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.626503:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2294 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.626523:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:1.0:1788620245.626526:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788620245.626530:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548400, rc 0) 00000100:00100000:1.0:1788620245.626590:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:9673:x1875504044984960:12345-192.168.201.11@tcp:101:rm.0 Request processed in 454us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620245.626597:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 25 00000100:00100000:1.0:1788620245.636619:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.637479:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044985216 00000100:00100000:3.0:1788620245.637491:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044985216 00000100:00100000:3.0:1788620245.637557:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 26 00000100:00100000:3.0:1788620245.637568:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:9673:x1875504044985216:12345-192.168.201.11@tcp:101:rm.0 00010000:00010000:3.0:1788620245.637587:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620245.637606:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd065e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b229b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620245.638792:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788620245.639081:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd065e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b229b expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.639794:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43900) 00010000:00010000:3.0:1788620245.639798:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620245.639805:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd065e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b229b expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.639821:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925200, rc 0) 00000100:00100000:2.0:1788620245.641581:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:9673:x1875504044985216:12345-192.168.201.11@tcp:101:rm.0 Request processed in 4000us (4957us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788620245.641596:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 26 00000100:00100000:0.0:1788620245.651104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620245.651632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044985344 00000100:00100000:1.0:1788620245.651642:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044985344 00000100:00100000:1.0:1788620245.653728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:1.0:1788620245.653753:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:9673:x1875504044985344:12345-192.168.201.11@tcp:37:rm.0 00000100:00100000:1.0:1788620245.661892:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:9673:x1875504044985344:12345-192.168.201.11@tcp:37:rm.0 Request processed in 8141us (10789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620245.661918:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:2.0:1788620245.667410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.667503:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044985600 00000100:00100000:3.0:1788620245.667521:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044985600 00000100:00100000:3.0:1788620245.667619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:3.0:1788620245.667630:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:9673:x1875504044985600:12345-192.168.201.11@tcp:35:rm.0 00000100:00100000:3.0:1788620245.668558:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:9673:x1875504044985600:12345-192.168.201.11@tcp:35:rm.0 Request processed in 926us (1153us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788620245.668567:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:0.0:1788620245.672044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620245.672585:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044985856 00000100:00100000:1.0:1788620245.672597:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044985856 00000100:00100000:1.0:1788620245.672658:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:1.0:1788620245.672667:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:9673:x1875504044985856:12345-192.168.201.11@tcp:101:rm.0 00010000:00010000:1.0:1788620245.672702:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620245.672722:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd066c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22a2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.672841:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0673 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.672855:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.672878:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620245.672889:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788620245.673023:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd066c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22a2 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.673052:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0673 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22a2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.673062:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:1.0:1788620245.673065:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788620245.673069:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548c00, rc 0) 00000100:00100000:1.0:1788620245.673162:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:9673:x1875504044985856:12345-192.168.201.11@tcp:101:rm.0 Request processed in 495us (1135us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788620245.673170:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:2.0:1788620245.677499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.677718:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044985984 00000100:00100000:0.0:1788620245.677743:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044985984 00000100:00100000:0.0:1788620245.677804:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00100000:0.0:1788620245.677814:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:9673:x1875504044985984:12345-192.168.201.11@tcp:41:rm.0 00000004:00000024:0.0:1788620245.677871:0:8736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7718567936 avail 7714373632 00000100:00100000:0.0:1788620245.677959:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:9673:x1875504044985984:12345-192.168.201.11@tcp:41:rm.0 Request processed in 146us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.677966:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00100000:2.0:1788620245.686610:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620245.686718:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044986112 00000100:00100000:1.0:1788620245.686728:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044986112 00000100:00100000:1.0:1788620245.686787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 29 00000100:00100000:1.0:1788620245.686798:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:9673:x1875504044986112:12345-192.168.201.11@tcp:101:rm.0 00010000:00010000:1.0:1788620245.686819:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620245.686839:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22a9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.686905:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.686919:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.686929:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.686944:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.686951:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.686958:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687343:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687370:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687377:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620245.687406:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788620245.687410:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620245.687428:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687440:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687449:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687456:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687462:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687467:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620245.687472:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687479:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687492:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:1.0:1788620245.687494:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620245.687505:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687521:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548e00/0x24857de440bd0688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687539:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687545:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687550:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687555:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620245.687558:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687564:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687572:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffffa0d64c7c2800) 00010000:00010000:1.0:1788620245.687575:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620245.687578:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687584:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548000/0x24857de440bd068f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687616:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22a9 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687642:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22a9 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.687649:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d65309ed00) 00010000:00010000:1.0:1788620245.687651:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620245.687654:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620245.687730:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:9673:x1875504044986112:12345-192.168.201.11@tcp:101:rm.0 Request processed in 933us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620245.687738:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 29 00000100:00100000:1.0:1788620245.692353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620245.692628:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044986368 00000100:00100000:0.0:1788620245.692638:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044986368 00000100:00100000:0.0:1788620245.692700:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 30 00000100:00100000:0.0:1788620245.692711:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:9673:x1875504044986368:12345-192.168.201.11@tcp:36:rm.0 00010000:00010000:0.0:1788620245.692763:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788620245.692789:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22a9 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.692813:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b228d expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.692825:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d65309ed00) 00010000:00010000:0.0:1788620245.692841:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2294 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.692852:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:0.0:1788620245.692856:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620245.693005:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693019:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693212:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693228:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693235:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693241:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693532:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693541:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.693548:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620245.694712:0:8736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788620245.694727:0:8736:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295733476462ns, next at 296733472525ns, rc = 0 00010000:00010000:0.0:1788620245.694802:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.694814:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.694825:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.694844:0:8736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.694851:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.694858:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695719:0:8736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620245.695744:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695751:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695757:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695763:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620245.695768:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695775:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695789:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d642f43000) 00010000:00010000:0.0:1788620245.695792:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788620245.695797:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695815:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd06ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695837:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695843:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695850:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695855:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620245.695858:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695875:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695884:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:0.0:1788620245.695886:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620245.695890:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.695896:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd069d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620245.695906:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001157e674 reply state 0000000019812cdf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620245.695916:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620245.696017:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:9673:x1875504044986368:12345-192.168.201.11@tcp:36:rm.0 Request processed in 3303us (3669us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788620245.696025:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 30 00010000:00010000:0.0:1788620245.698678:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.698704:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.698713:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.698720:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620245.698725:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.698733:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.698749:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffffa0d642f43200) 00010000:00010000:0.0:1788620245.698753:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620245.698757:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620245.698763:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519200/0x24857de440bd06a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.699693:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620245.699703:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.699712:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620245.699716:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.699723:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.699735:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0d642f43000) 00010000:00010000:1.0:1788620245.699738:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788620245.699741:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.699747:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd06b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620245.699788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620245.699790:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620245.699792:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620245.702912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620245.703020:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044986624 00000100:00100000:2.0:1788620245.703038:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044986624 00000100:00100000:2.0:1788620245.703111:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620245.703122:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:9673:x1875504044986624:12345-192.168.201.11@tcp:35:rm.0 00000100:00100000:2.0:1788620245.703421:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:9673:x1875504044986624:12345-192.168.201.11@tcp:35:rm.0 Request processed in 300us (518us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788620245.703428:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620245.707612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620245.707712:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044986880 00000100:00100000:3.0:1788620245.707722:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044986880 00000100:00100000:3.0:1788620245.707781:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:3.0:1788620245.707791:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:9673:x1875504044986880:12345-192.168.201.11@tcp:36:rm.0 00010000:00010000:3.0:1788620245.707854:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788620245.707883:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22a2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.707910:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b227f expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.707921:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d64c7c2600) 00010000:00010000:3.0:1788620245.707953:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519600/0x24857de440bd05d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2271 expref: 14 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.707963:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43900) 00010000:00010000:3.0:1788620245.707970:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620245.708006:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708018:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708026:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708037:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708044:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708050:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708408:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708416:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.708423:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620245.709057:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788620245.709079:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709087:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709094:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709100:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620245.709104:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709111:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709121:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:3.0:1788620245.709124:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788620245.709128:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709134:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925400/0x24857de440bd06c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709152:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709158:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709163:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709167:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620245.709176:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709182:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709191:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620245.709194:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620245.709196:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620245.709201:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd06b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788620245.709214:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000129d4741 reply state 00000000f9fdcd59 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620245.709222:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620245.709335:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:9673:x1875504044986880:12345-192.168.201.11@tcp:36:rm.0 Request processed in 1543us (1732us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788620245.709344:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 31 00010000:00010000:2.0:1788620245.712127:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.712144:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.712152:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.712176:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620245.712182:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.712191:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.712209:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0d65309e200) 00010000:00010000:2.0:1788620245.712212:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620245.712216:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620245.712223:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd06c0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620245.866968:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061793792:0@lo:400:kworker.0 00000100:00100000:3.0:1788620245.867048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620245.867112:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061794304:0@lo:400:kworker.0 00000100:00100000:3.0:1788620245.867139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620245.867170:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620245.867177:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061793920:0@lo:400:kworker.0 00000100:00100000:3.0:1788620245.867201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620245.867232:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061794304 00000100:00100000:3.0:1788620245.867240:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061794304 00000100:00100000:3.0:1788620245.867333:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788620245.867343:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061794304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620245.867393:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061794304:12345-0@lo:400:kworker.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620245.867400:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788620245.867438:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6809f5880 x1875504061794304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620245.867452:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061794304:0@lo:400:kworker.0 00000100:00100000:2.0:1788620245.867657:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793792 00000100:00100000:2.0:1788620245.867662:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793792 00000100:00100000:2.0:1788620245.867702:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793920 00000100:00100000:2.0:1788620245.867705:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793920 00000100:00100000:2.0:1788620245.867725:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788620245.867732:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061793792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620245.867768:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061793792:12345-0@lo:400:kworker.0 Request processed in 37us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620245.867774:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788620245.867787:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788620245.867793:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061793920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620245.867820:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061793920:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620245.867836:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788620245.868809:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061793536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620245.868854:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620245.868891:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061794048:0@lo:400:kworker.0 00000100:00100000:0.0:1788620245.868914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620245.868945:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788620245.868952:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061793664:0@lo:400:kworker.0 00000100:00100000:0.0:1788620245.868977:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620245.869011:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061794176:0@lo:400:kworker.0 00000100:00100000:0.0:1788620245.869033:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788620245.869059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620245.869064:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620245.869075:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061794048 00000100:00100000:0.0:1788620245.869082:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061794048 00000100:00100000:0.0:1788620245.869122:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788620245.869129:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061794048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620245.869166:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061794048:12345-0@lo:400:kworker.0 Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.869174:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788620245.869194:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793536 00000100:00100000:0.0:1788620245.869198:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793536 00000100:00100000:0.0:1788620245.869222:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788620245.869227:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061793536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620245.869287:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788620245.869333:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061793536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.869340:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788620245.869358:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061793664 00000100:00100000:0.0:1788620245.869361:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061793664 00000100:00100000:0.0:1788620245.869382:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788620245.869388:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061793664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620245.869413:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061793664:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.869426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1788620245.869454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620245.869476:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061793664:0@lo:400:kworker.0 00010000:00080000:0.0:1788620245.869489:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807dc000 x1875504061793536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620245.869516:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061793536:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788620245.869526:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6809f4a80 x1875504061794048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620245.869533:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061794048:0@lo:400:kworker.0 00000100:00100000:0.0:1788620245.869561:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061794176 00000100:00100000:0.0:1788620245.869564:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061794176 00000100:00100000:0.0:1788620245.869588:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788620245.869594:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061794176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620245.869628:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061794176:12345-0@lo:400:kworker.0 Request processed in 34us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620245.869634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788620245.869647:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620245.869664:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061794176:0@lo:400:kworker.0 00000100:00100000:3.0:1788620245.870885:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061793920:0@lo:400:kworker.0 00000100:00100000:3.0:1788620245.870900:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061793792:0@lo:400:kworker.0 00010000:00010000:0.0:1788620246.312769:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620246.382100:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061794432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620246.382185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620246.382358:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061794432 00000100:00100000:1.0:1788620246.382366:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061794432 00000100:00100000:1.0:1788620246.382417:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788620246.382427:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061794432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620246.382449:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620246.382834:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061794432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 407us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620246.382842:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788620246.382886:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680b77b80 x1875504061794432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620246.382906:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061794432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620247.341336:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620248.360539:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620249.389778:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788620249.573065:0:11612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788620250.408491:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620250.438584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620250.438637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620250.438674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620250.438711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620250.438740:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987136 00000100:00100000:2.0:1788620250.438748:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987136 00000100:00100000:2.0:1788620250.438805:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987392 00000100:00100000:2.0:1788620250.438808:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987392 00000100:00100000:2.0:1788620250.438829:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 94 00000100:00100000:2.0:1788620250.438850:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:2355:x1875504044987136:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620250.438924:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:2355:x1875504044987136:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620250.438931:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 94 00000100:00100000:2.0:1788620250.438950:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 95 00000100:00100000:2.0:1788620250.438956:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044987392:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620250.438975:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044987392:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 20us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620250.438980:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 95 00000100:00080000:2.0:1788620250.438993:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620250.439194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987008 00000100:00100000:3.0:1788620250.439197:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987008 00000100:00100000:3.0:1788620250.439223:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 245 00000100:00100000:3.0:1788620250.439228:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044987008:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620250.439274:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044987008:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 46us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620250.439278:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 245 00000100:00100000:0.0:1788620250.442328:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987264 00000100:00100000:0.0:1788620250.442341:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987264 00000100:00100000:0.0:1788620250.442609:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:0.0:1788620250.442622:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044987264:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620250.442700:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044987264:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 82us (4062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.442720:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00080000:3.0:1788620250.444167:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788620250.725012:0:11661:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2d344a40 20000000:00000080:2.0:1788620250.725029:0:11661:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0d542803c00 uarg=0000000000000000 20000000:01000000:2.0:1788620250.725066:0:11661:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788620250.725073:0:11661:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788620250.725085:0:11661:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788620250.726226:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788620250.733321:0:11661:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788620250.769372:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788620250.769477:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788620250.769550:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788620250.769570:0:11661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788620250.769602:0:11661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.770718:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.770727:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.770735:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd057e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.770742:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd058c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.770748:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd059a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.770755:0:11661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.771687:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd059a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.771705:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd059a expref: 18 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620250.771719:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794560:0@lo:104: 00000100:00100000:3.0:1788620250.771782:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620250.772569:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd058c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.772580:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd058c expref: 18 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620250.772618:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e05c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794688:0@lo:104: 00000100:00100000:3.0:1788620250.772656:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620250.772688:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd057e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.772697:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd057e expref: 18 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620250.772705:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794816:0@lo:104: 00000100:00100000:3.0:1788620250.772732:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620250.772732:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061794560 00000100:00100000:0.0:1788620250.772742:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061794560 00010000:00010000:3.0:1788620250.772762:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620250.772773:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 12 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620250.772794:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794944:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620250.772806:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788620250.772819:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061794688 00000100:00100000:0.0:1788620250.772823:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061794688 00000100:00100000:0.0:1788620250.772851:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061794816 00000100:00100000:0.0:1788620250.772855:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061794816 00010000:00010000:3.0:1788620250.772859:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620250.772873:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788620250.772885:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 12 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620250.772886:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+5:11661:x1875504061794560:12345-0@lo:104: 00000100:00100000:3.0:1788620250.772901:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061795072:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620250.772904:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620250.772927:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788620250.772979:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794560:0@lo:104: 00010000:00010000:0.0:1788620250.772986:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788620250.772993:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+5:11661:x1875504061794560:12345-0@lo:104: Request processed in 111us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.773001:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620250.773019:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620250.773025:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:11661:x1875504061794688:12345-0@lo:104: 00010000:00010000:0.0:1788620250.773032:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.773088:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788620250.773094:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+4:11661:x1875504061794688:12345-0@lo:104: Request processed in 70us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.773100:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620250.773115:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788620250.773130:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d542801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:11661:x1875504061794816:12345-0@lo:104: 00010000:00010000:0.0:1788620250.773139:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.773185:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788620250.773190:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d542801450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e39889e-8996-4811-9fe8-f1c6c0211740+3:11661:x1875504061794816:12345-0@lo:104: Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.773197:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788620250.773232:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788620250.773238:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.773267:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519800 already unused, calling callback (ffffffffc1d33c20) 00010000:00010000:2.0:1788620250.773269:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1788620250.773273:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773277:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.773286:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773289:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620250.773295:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620250.773298:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620250.773312:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620250.773313:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620250.773323:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620250.773329:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788620250.773344:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773349:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.773353:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620250.773360:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620250.773378:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773492:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd058c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0593 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773504:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620250.773507:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773524:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924c00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620250.773527:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773532:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620250.773537:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620250.773541:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620250.773557:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773563:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620250.773587:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773594:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680924c00/0x24857de440bd057e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd0585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620250.773603:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620250.773605:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620250.773607:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620250.773618:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061795328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620250.773649:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620250.773711:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061795456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620250.773738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620250.774414:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e05c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794688:0@lo:104: 00000100:00100000:3.0:1788620250.774448:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794816:0@lo:104: 00010000:00010000:0.0:1788620250.775190:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775216:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d67a519800/0x24857de440bd059a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd05a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775240:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620250.775242:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620250.775245:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620250.775275:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620250.775290:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061795200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620250.775340:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620250.775385:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061795328 00000100:00100000:0.0:1788620250.775391:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061795328 00010000:00010000:0.0:1788620250.775430:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd058c expref: 19 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620250.775450:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061795456 00000100:00100000:0.0:1788620250.775453:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061795456 00010000:00010000:0.0:1788620250.775465:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd057e expref: 20 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620250.775475:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061795200 00000100:00100000:0.0:1788620250.775477:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061795200 00010000:00010000:0.0:1788620250.775499:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd059a expref: 21 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620250.775513:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788620250.775520:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+21:3311:x1875504061795328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620250.775533:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620250.775538:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd058c expref: 21 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775554:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd058c expref: 21 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775569:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a518a00/0x24857de440bd0593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd058c expref: 21 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775583:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620250.775615:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+20:3311:x1875504061795328:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.775622:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788620250.775640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788620250.775646:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061795456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620250.775654:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620250.775659:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd057e expref: 19 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775667:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd057e expref: 19 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775677:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a519c00/0x24857de440bd0585 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd057e expref: 19 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775685:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620250.775789:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:3308:x1875504061795456:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.775795:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788620250.775808:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788620250.775814:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3310:x1875504061795200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620250.775826:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620250.775830:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd059a expref: 17 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775839:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd059a expref: 17 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775849:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680925c00/0x24857de440bd05a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd059a expref: 17 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.775858:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620250.775888:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3310:x1875504061795200:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.775894:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788620250.775949:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061795200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620250.777588:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061795328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620250.785272:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061795456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620250.788094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620250.788137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620250.788172:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987648 00000100:00100000:1.0:1788620250.788182:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987648 00010000:00010000:1.0:1788620250.788227:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 13 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620250.788242:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987520 00000100:00100000:0.0:1788620250.788246:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987520 00010000:00010000:0.0:1788620250.788282:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 14 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620250.788295:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:1.0:1788620250.788305:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+14:2356:x1875504044987648:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620250.788321:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620250.788328:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 14 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620250.788340:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 14 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620250.788356:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788620250.788361:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620250.788372:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788620250.788433:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+14:2356:x1875504044987648:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 115us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620250.788540:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061794944:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620250.788563:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2200/0x24857de440bd0570 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b225c expref: 14 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620250.788577:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875504061795072:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620250.788609:0:11661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620250.791345:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:0.0:1788620250.791367:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504044987520:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620250.791386:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620250.791394:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 13 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.791410:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 13 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.791458:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a518e00/0x24857de440bd0577 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2263 expref: 13 pid: 5834 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.791473:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.791481:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792444:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792453:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792462:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792468:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792475:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620250.792479:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792496:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792527:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.792550:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620250.792607:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:2356:x1875504044987520:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 1248us (4469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.792616:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 34 00010000:00010000:0.0:1788620250.794951:0:11661:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620250.794958:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 33 00010000:00010000:0.0:1788620250.794978:0:11661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620250.794984:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924400/0x24857de440bd06ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620250.985150:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061795968:0@lo:400:kworker.0 00000100:00100000:1.0:1788620250.985150:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061795712:0@lo:400:kworker.0 00000100:00100000:2.0:1788620250.985244:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061795584:0@lo:400:kworker.0 00000100:00100000:1.0:1788620250.990096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620250.990180:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788620250.990218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620250.990271:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620250.990279:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061795840:0@lo:400:kworker.0 00000100:00100000:1.0:1788620250.990303:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620250.990344:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796224 00000100:00100000:1.0:1788620250.990352:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796224 00000100:00100000:1.0:1788620250.990428:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620250.990439:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061796224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620250.990495:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061796224:12345-0@lo:400:kworker.0 Request processed in 58us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620250.990519:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620250.990543:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061795712 00000100:00100000:1.0:1788620250.990547:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061795712 00000100:00100000:1.0:1788620250.990570:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061795840 00000100:00100000:1.0:1788620250.990573:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061795840 00000100:00100000:1.0:1788620250.990592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788620250.990598:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061795712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620250.992405:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061795712:0@lo:400:kworker.0 00010000:00080000:0.0:1788620250.992441:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67f80ca80 x1875504061796224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620250.992454:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061796224:0@lo:400:kworker.0 00000100:00100000:0.0:1788620250.992506:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788620250.992519:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061795840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620250.992590:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061795840:12345-0@lo:400:kworker.0 Request processed in 77us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.992596:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788620250.992632:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061795840:0@lo:400:kworker.0 00000100:00100000:0.0:1788620250.992710:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061796352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620250.992757:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620250.993585:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796352 00000100:00100000:0.0:1788620250.993593:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796352 00000100:00100000:0.0:1788620250.993634:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788620250.993641:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061796352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620250.993670:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788620250.993722:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061796352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620250.993728:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788620250.993763:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67a11d180 x1875504061796352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620250.993779:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061796352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620250.994430:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061795712:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620250.994441:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788620250.997049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788620250.997060:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620250.997354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620250.997395:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061795968 00000100:00100000:3.0:1788620250.997439:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061795968 00000100:00100000:3.0:1788620250.997494:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788620250.997503:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061795968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620250.997554:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061795968:12345-0@lo:400:kworker.0 Request processed in 52us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620250.997561:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788620250.997601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788620250.997713:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d67f80ea00 x1875504061795968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620250.997783:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061795968:0@lo:400:kworker.0 00000100:00100000:2.0:1788620251.001304:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620251.001348:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061795584 00000100:00100000:2.0:1788620251.001356:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061795584 00000100:00100000:2.0:1788620251.001402:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788620251.001411:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3309:x1875504061795584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620251.001478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3309:x1875504061795584:12345-0@lo:400:kworker.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620251.001485:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788620251.001541:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061795584:0@lo:400:kworker.0 00000100:00100000:2.0:1788620251.001553:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061796096:0@lo:400:kworker.0 00000100:00100000:2.0:1788620251.001582:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620251.001609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796096 00000100:00100000:2.0:1788620251.001613:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796096 00000100:00100000:2.0:1788620251.001648:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788620251.001655:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061796096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620251.001689:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061796096:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620251.001696:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788620251.001727:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061796096:0@lo:400:kworker.0 00000100:00080000:3.0:1788620251.001934:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788620251.097995:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1788620251.098009:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788620251.098044:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1788620251.098055:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1788620251.098971:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061796480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788620251.099050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620251.099846:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796480 00000100:00100000:0.0:1788620251.099856:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796480 00000100:00100000:0.0:1788620251.100069:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788620251.100080:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061796480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788620251.100112:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788620251.100147:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c2dd5, atime: 0x6a9c2dd5, ctime: 0x6a9c2dd5, blocks: 0x1 00010000:00010000:0.0:1788620251.100155:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620251.100171:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:0.0:1788620251.100175:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620251.100183:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620251.100215:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620251.100225:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620251.100233:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620251.100378:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788620251.101922:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061796480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1838us (2866us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788620251.101933:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788620251.103838:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620251.103854:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620251.103868:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620251.103874:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620251.103884:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620251.103913:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620251.103921:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd06d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620251.103948:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620251.103950:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620251.103952:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788620251.104551:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d67a11d180/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788620251.104562:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061796480:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788620251.432603:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620251.496421:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620251.496451:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061796608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620251.496518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620251.496597:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796608 00000100:00100000:1.0:1788620251.496603:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796608 00000100:00100000:1.0:1788620251.496653:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788620251.496665:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061796608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620251.496698:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620251.496738:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061796608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620251.496745:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788620251.496785:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061796608:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788620252.008423:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620252.008432:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d675d13000 from 7 10000000:01000000:3.0:1788620252.008437:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620252.008492:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620252.008505:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620252.008518:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620252.008545:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061796736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.008625:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620252.008685:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.010359:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796736 00000100:00100000:0.0:1788620252.010373:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796736 00000100:00100000:0.0:1788620252.010459:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788620252.010470:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+16:5836:x1875504061796736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620252.010487:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620252.010506:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a518a00/0x24857de440bd06e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd06dc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.010534:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a518a00/0x24857de440bd06e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd06dc expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.010545:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a518a00/0x24857de440bd06e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd06dc expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.010584:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518a00, rc 0) 00000100:00100000:0.0:1788620252.010664:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061796736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.010671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788620252.011085:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061796736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620252.011105:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620252.011117:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620252.011187:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061796864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.011241:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620252.011299:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.012306:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796864 00000100:00100000:0.0:1788620252.012318:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796864 00000100:00100000:0.0:1788620252.012374:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788620252.012385:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061796864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.012710:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061796864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.012718:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788620252.013455:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061796864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.013519:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061796992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.013570:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620252.013618:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620252.013689:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061796992 00000100:00100000:1.0:1788620252.013696:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061796992 00000100:00100000:1.0:1788620252.013737:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788620252.013755:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061796992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.013948:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061796992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620252.013956:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788620252.014194:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061796992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.015598:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11675:1875504061797120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620252.015670:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620252.015711:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620252.015783:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061797120 00000100:00100000:2.0:1788620252.015790:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061797120 00000100:00100000:2.0:1788620252.015836:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788620252.015858:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:11675:x1875504061797120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620252.016067:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+17:11675:x1875504061797120:12345-0@lo:502:llog_process_th.0 Request processed in 223us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620252.016085:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788620252.016374:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11675:1875504061797120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620252.016417:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620252.016427:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620252.016430:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788620252.016437:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0d675d13000 00000020:00000080:3.0:1788620252.016440:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788620252.016520:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11675:1875504061797248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620252.016558:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620252.016592:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.016799:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061797248 00000100:00100000:0.0:1788620252.016805:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061797248 00000100:00100000:0.0:1788620252.016864:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788620252.016873:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:11675:x1875504061797248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620252.017045:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:11675:x1875504061797248:12345-0@lo:502:llog_process_th.0 Request processed in 173us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.017053:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788620252.017235:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11675:1875504061797248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788620252.017282:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620252.017289:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620252.017291:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788620252.017295:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788620252.017769:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788620252.017791:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620252.017802:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.017812:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620252.017836:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788620252.017838:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d680c0a000 from 7 10000000:01000000:0.0:1788620252.017841:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620252.018003:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.018012:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.018021:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620252.018041:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061797376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.018083:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620252.018121:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d541f730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620252.018181:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061797376 00000100:00100000:1.0:1788620252.018187:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061797376 00000100:00100000:1.0:1788620252.018239:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788620252.018287:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+17:5836:x1875504061797376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620252.018299:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620252.018311:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d64c548000/0x24857de440bd06f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd06ea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620252.018332:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d64c548000/0x24857de440bd06f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd06ea expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620252.018342:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d64c548000/0x24857de440bd06f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd06ea expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620252.018351:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548000, rc 0) 00000100:00100000:1.0:1788620252.018390:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061797376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620252.018407:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788620252.021209:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061797376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620252.021296:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.021314:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620252.021391:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061797504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.021466:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620252.021508:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d541f730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620252.021766:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061797504 00000100:00100000:3.0:1788620252.021774:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061797504 00000100:00100000:3.0:1788620252.021819:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788620252.021829:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061797504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.022118:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061797504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620252.022126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788620252.023179:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061797504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.024421:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061797632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.024516:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620252.024559:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d541f730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620252.024877:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061797632 00000100:00100000:1.0:1788620252.024885:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061797632 00000100:00100000:1.0:1788620252.024937:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788620252.024945:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061797632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.027197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061797632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2244us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620252.027222:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788620252.027353:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061797632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.029218:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11677:1875504061797760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620252.033710:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620252.034073:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.034127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061797760 00000100:00100000:0.0:1788620252.034137:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061797760 00000100:00100000:0.0:1788620252.034187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788620252.034198:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:11677:x1875504061797760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620252.039168:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d658163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:11677:x1875504061797760:12345-0@lo:502:llog_process_th.0 Request processed in 4959us (6182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.039184:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788620252.039199:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11677:1875504061797760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788620252.039357:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620252.039368:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620252.039371:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788620252.039377:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0d680c0a000 00000020:00000080:2.0:1788620252.039379:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788620252.039491:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11677:1875504061797888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620252.039540:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620252.039570:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620252.040160:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061797888 00000100:00100000:1.0:1788620252.040170:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061797888 00000100:00100000:1.0:1788620252.040213:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788620252.040223:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:11677:x1875504061797888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620252.040469:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:11677:x1875504061797888:12345-0@lo:502:llog_process_th.0 Request processed in 247us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620252.040478:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788620252.044218:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11677:1875504061797888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788620252.044303:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620252.044312:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620252.044314:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788620252.044319:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788620252.044915:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788620252.044937:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788620252.044949:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620252.044960:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620252.044971:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788620252.044983:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d649f43000 from 7 10000000:01000000:1.0:1788620252.044986:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788620252.045021:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620252.045029:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620252.045052:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620252.045076:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061798016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.045137:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620252.045182:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675c14c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.045472:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798016 00000100:00100000:0.0:1788620252.045480:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798016 00000100:00100000:0.0:1788620252.045538:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788620252.045547:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+18:5836:x1875504061798016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620252.045560:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620252.045574:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a519200/0x24857de440bd06ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd06f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.045596:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a519200/0x24857de440bd06ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd06f8 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.045617:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a519200/0x24857de440bd06ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd06f8 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620252.045634:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519200, rc 0) 00000100:00100000:0.0:1788620252.045679:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061798016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.045687:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788620252.046006:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061798016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620252.046022:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620252.046031:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620252.046086:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061798144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.046116:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620252.046152:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675c14c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.046540:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798144 00000100:00100000:0.0:1788620252.046546:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798144 00000100:00100000:0.0:1788620252.046576:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788620252.046584:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061798144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.047074:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061798144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 489us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.047082:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788620252.047154:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061798144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.047187:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061798272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.047233:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620252.047407:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675c14c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.047466:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798272 00000100:00100000:0.0:1788620252.047471:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798272 00000100:00100000:0.0:1788620252.047501:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788620252.047515:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061798272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.047665:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:5836:x1875504061798272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.047671:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788620252.047703:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e39889e-8996-4811-9fe8-f1c6c0211740:5836:1875504061798272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620252.048114:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11679:1875504061798400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620252.048149:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620252.048169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798400 00000100:00100000:0.0:1788620252.048172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798400 00000100:00100000:0.0:1788620252.048189:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788620252.048200:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:11679:x1875504061798400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620252.048483:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:11679:x1875504061798400:12345-0@lo:502:llog_process_th.0 Request processed in 282us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.048490:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788620252.048576:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788620252.048589:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11679:1875504061798400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788620252.048730:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620252.048739:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620252.048741:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788620252.048748:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0d649f43000 00000020:00000080:0.0:1788620252.048750:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788620252.048916:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11679:1875504061798528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620252.048949:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620252.048989:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788620252.049033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798528 00000100:00100000:2.0:1788620252.049038:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798528 00000100:00100000:2.0:1788620252.049070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788620252.049076:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:11679:x1875504061798528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620252.049196:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:11679:x1875504061798528:12345-0@lo:502:llog_process_th.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620252.049203:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788620252.049450:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a11dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e39889e-8996-4811-9fe8-f1c6c0211740:11679:1875504061798528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788620252.049470:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620252.049475:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620252.049477:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788620252.049480:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788620252.049631:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788620252.049652:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620252.049661:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620252.049672:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620252.074132:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788620252.456515:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620252.554895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620252.555464:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987776 00000100:00100000:3.0:1788620252.555475:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987776 00000100:00100000:3.0:1788620252.555557:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 262 00000100:00100000:3.0:1788620252.555567:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:5593:x1875504044987776:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620252.555584:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620252.555603:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d680924a00/0x24857de440bd0706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22b0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620252.555631:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d680924a00/0x24857de440bd0706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22b0 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620252.555642:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d680924a00/0x24857de440bd0706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22b0 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620252.555652:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924a00, rc 0) 00000100:00100000:3.0:1788620252.555728:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044987776:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 162us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620252.555735:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 262 00000100:00100000:0.0:1788620252.564165:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620252.564443:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044987904 00000100:00100000:1.0:1788620252.564454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044987904 00000100:00100000:1.0:1788620252.564504:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 263 00000100:00100000:1.0:1788620252.564514:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044987904:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.564871:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044987904:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 356us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620252.564887:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 263 00000100:00100000:1.0:1788620252.572550:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620252.572783:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988032 00000100:00100000:2.0:1788620252.572805:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988032 00000100:00100000:2.0:1788620252.572860:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 264 00000100:00100000:2.0:1788620252.572870:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044988032:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620252.573078:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044988032:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 Request processed in 208us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620252.573085:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 264 00000100:00100000:2.0:1788620252.580736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620252.582811:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988160 00000100:00100000:3.0:1788620252.582826:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988160 00000100:00100000:3.0:1788620252.582917:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 265 00000100:00100000:3.0:1788620252.582928:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:9943:x1875504044988160:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620252.583209:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:9943:x1875504044988160:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 281us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620252.583218:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 265 00000100:00100000:0.0:1788620252.590305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620252.592381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988288 00000100:00100000:1.0:1788620252.592405:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988288 00000100:00100000:1.0:1788620252.592477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 266 00000100:00100000:1.0:1788620252.592488:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:9943:x1875504044988288:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620252.592752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:9943:x1875504044988288:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 265us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620252.592760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 266 00000100:00100000:1.0:1788620252.599202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620252.617984:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988416 00000100:00100000:2.0:1788620252.618001:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988416 00000100:00100000:2.0:1788620252.618071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 267 00000100:00100000:2.0:1788620252.618081:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:5593:x1875504044988416:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620252.618109:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620252.618129:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3c00/0x24857de440bd070d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620252.618162:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3c00/0x24857de440bd070d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22b7 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620252.618184:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe3c00/0x24857de440bd070d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22b7 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620252.618194:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3c00, rc 0) 00000100:00100000:2.0:1788620252.618287:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044988416:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 206us (19094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620252.618295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 267 00000100:00100000:2.0:1788620252.626158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620252.626403:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988544 00000100:00100000:3.0:1788620252.626426:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988544 00000100:00100000:3.0:1788620252.626485:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 268 00000100:00100000:3.0:1788620252.626496:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044988544:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620252.626803:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044988544:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 307us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620252.626810:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 268 00000100:00100000:3.0:1788620252.630401:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620252.630492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988672 00000100:00100000:1.0:1788620252.630503:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988672 00000100:00100000:1.0:1788620252.630570:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 269 00000100:00100000:1.0:1788620252.630580:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044988672:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620252.630816:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:5593:x1875504044988672:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 Request processed in 235us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620252.630825:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 269 00000100:00100000:1.0:1788620252.637039:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620252.637462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988800 00000100:00100000:2.0:1788620252.637487:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988800 00000100:00100000:2.0:1788620252.637545:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 270 00000100:00100000:2.0:1788620252.637556:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:9946:x1875504044988800:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788620252.637814:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:9946:x1875504044988800:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 259us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620252.637822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 270 00000100:00100000:2.0:1788620252.648405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620252.648743:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044988928 00000100:00100000:0.0:1788620252.648755:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044988928 00000100:00100000:0.0:1788620252.648817:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 271 00000100:00100000:0.0:1788620252.648828:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:9946:x1875504044988928:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620252.649101:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:9946:x1875504044988928:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 267us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620252.649116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 271 00000040:00080000:3.0:1788620253.097245:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788620253.480881:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620254.504621:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620255.528802:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620255.561000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620255.561045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620255.561076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620255.561114:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620255.561149:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989184 00000100:00100000:2.0:1788620255.561159:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989184 00000100:00100000:1.0:1788620255.561212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989056 00000100:00100000:1.0:1788620255.561218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989056 00000100:00100000:1.0:1788620255.561298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 272 00000100:00100000:1.0:1788620255.561309:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504044989056:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620255.561394:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504044989056:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 87us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620255.561430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 272 00000100:00100000:1.0:1788620255.561467:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989440 00000100:00100000:1.0:1788620255.561471:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989440 00000100:00100000:3.0:1788620255.561782:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989312 00000100:00100000:3.0:1788620255.561786:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989312 00000100:00100000:2.0:1788620255.561864:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 99 00000100:00100000:2.0:1788620255.561873:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044989184:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620255.561912:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044989184:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 41us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620255.561919:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 99 00000100:00080000:0.0:1788620255.565373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620255.565385:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620255.569784:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 100 00000100:00100000:1.0:1788620255.569801:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504044989440:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620255.569911:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504044989440:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 114us (8795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620255.569919:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 100 00000100:00100000:3.0:1788620255.571792:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:3.0:1788620255.571807:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044989312:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620255.571996:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044989312:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 193us (10949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620255.572005:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:1.0:1788620256.104648:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620256.104672:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061798656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620256.104752:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620256.104816:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798656 00000100:00100000:1.0:1788620256.104823:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798656 00000100:00100000:1.0:1788620256.104876:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788620256.104885:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061798656:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620256.105109:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061798912:0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620256.105192:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620256.105201:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061799040:0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620256.105281:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798912 00000100:00100000:2.0:1788620256.105285:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798912 00000100:00100000:2.0:1788620256.105309:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799040 00000100:00100000:2.0:1788620256.105311:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799040 00000100:00100000:2.0:1788620256.105342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788620256.105349:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061798912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105412:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061798912:12345-0@lo:400:kworker.0 Request processed in 63us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620256.105419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788620256.105436:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788620256.105442:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061799040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105470:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061799040:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620256.105476:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788620256.105635:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061799040:0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105644:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061798912:0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105665:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061798784:0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620256.105772:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061799296:0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.105791:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620256.105806:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788620256.105810:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.106093:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620256.106135:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799296 00000100:00100000:2.0:1788620256.106139:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799296 00002000:00000024:1.0:1788620256.106511:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788620256.106557:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061798656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1673us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620256.106564:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788620256.106640:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788620256.106648:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061799296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620256.106679:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061799296:12345-0@lo:400:kworker.0 Request processed in 33us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620256.106685:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788620256.106769:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799168 00000100:00100000:1.0:1788620256.106773:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799168 00000100:00100000:1.0:1788620256.106794:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788620256.106798:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061799168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620256.106820:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061799168:12345-0@lo:400:kworker.0 Request processed in 23us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620256.106824:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788620256.106880:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061798784 00000100:00100000:1.0:1788620256.106884:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061798784 00000100:00080000:0.0:1788620256.106993:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620256.106997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620256.106998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620256.107012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788620256.107019:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061798784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620256.107052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061798784:12345-0@lo:400:kworker.0 Request processed in 35us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620256.107058:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788620256.107369:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061799168:0@lo:400:kworker.0 00000100:00100000:3.0:1788620256.107392:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061798784:0@lo:400:kworker.0 00000100:00100000:3.0:1788620256.107401:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061799296:0@lo:400:kworker.0 00010000:00080000:3.0:1788620256.107413:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6809f4700 x1875504061798656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620256.107429:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061798656:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788620256.174510:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788620256.558137:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620256.620379:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061799424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620256.620459:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620256.620904:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799424 00000100:00100000:3.0:1788620256.620919:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799424 00000100:00100000:3.0:1788620256.620980:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788620256.621004:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061799424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620256.621041:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620256.630020:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061799424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9005us (9549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620256.630036:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788620256.636171:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788620256.636186:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d67a11d180, transno 4294967300 00000100:00100000:2.0:1788620256.636294:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061799424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788620257.578802:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620258.600553:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620259.624498:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620260.648531:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620260.681304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620260.681348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620260.681358:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989568 00000100:00100000:2.0:1788620260.681369:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989568 00000100:00100000:0.0:1788620260.681386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620260.681423:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 274 00000100:00100000:0.0:1788620260.681430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620260.681435:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044989568:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620260.681461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989696 00000100:00100000:0.0:1788620260.681466:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989696 00000100:00100000:2.0:1788620260.681500:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044989568:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 68us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620260.681509:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 274 00000100:00100000:0.0:1788620260.681510:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989952 00000100:00100000:0.0:1788620260.681515:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989952 00000100:00100000:0.0:1788620260.681559:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 104 00000100:00100000:0.0:1788620260.681568:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044989696:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620260.681605:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044989696:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620260.681755:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 104 00000100:00100000:1.0:1788620260.681805:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044989824 00000100:00100000:1.0:1788620260.681809:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044989824 00000100:00100000:1.0:1788620260.681835:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:1.0:1788620260.681840:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044989824:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620260.681864:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044989824:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620260.681868:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00080000:1.0:1788620260.681935:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620260.681939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620260.682668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 105 00000100:00100000:2.0:1788620260.682682:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044989952:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620260.682726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044989952:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 50us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620260.682733:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 105 00000100:00100000:3.0:1788620261.224622:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620261.224649:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061799552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620261.224728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620261.224937:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799552 00000100:00100000:2.0:1788620261.224946:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799552 00000100:00100000:2.0:1788620261.225012:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788620261.225030:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061799552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620261.225064:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788620261.225126:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061799552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620261.225133:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788620261.225342:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061799680:0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225377:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620261.225402:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061800192:0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225425:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620261.225444:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620261.225449:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061799808:0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225469:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620261.225492:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799680 00000100:00100000:1.0:1788620261.225496:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799680 00000100:00080000:3.0:1788620261.225516:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620261.225521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788620261.225527:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061799680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620261.225528:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061799936:0@lo:400:kworker.0 00000100:00100000:3.0:1788620261.225552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620261.225559:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061799680:12345-0@lo:400:kworker.0 Request processed in 33us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620261.225566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00080000:3.0:1788620261.225580:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6809f4e00 x1875504061799552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620261.225590:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061800064:0@lo:400:kworker.0 00000100:00100000:3.0:1788620261.225599:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061799552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620261.225625:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800192 00000100:00100000:1.0:1788620261.225625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620261.225628:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800192 00000100:00100000:1.0:1788620261.225653:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800064 00000100:00100000:1.0:1788620261.225656:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800064 00000100:00100000:3.0:1788620261.225658:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799808 00000100:00100000:3.0:1788620261.225660:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799808 00000100:00100000:3.0:1788620261.225671:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061799936 00000100:00100000:3.0:1788620261.225673:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061799936 00000100:00100000:1.0:1788620261.225680:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788620261.225685:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788620261.225686:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061800064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620261.225690:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061800192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620261.225715:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061800192:12345-0@lo:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620261.225717:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061800064:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620261.225721:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788620261.225723:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788620261.225734:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788620261.225739:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061799808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225748:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061800064:0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225765:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788620261.225771:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061799808:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620261.225772:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061799936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620261.225777:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788620261.225791:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620261.225794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620261.225801:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061799936:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620261.225807:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061799936:0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225807:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788620261.225833:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061799808:0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225841:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061799680:0@lo:400:kworker.0 00000100:00100000:1.0:1788620261.225849:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061800192:0@lo:400:kworker.0 00010000:00010000:0.0:1788620261.672965:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620261.736855:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620261.736880:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061800320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620261.736951:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620261.737223:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800320 00000100:00100000:2.0:1788620261.737240:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800320 00000100:00100000:2.0:1788620261.737313:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788620261.737320:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061800320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620261.737350:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620261.737566:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061800320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620261.737572:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788620261.738396:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061800320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620262.696611:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788620263.337193:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788620263.720502:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620264.744554:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620265.769377:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620265.805521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620265.805578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620265.805612:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990208 00000100:00100000:3.0:1788620265.805622:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990208 00000100:00100000:3.0:1788620265.805683:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 109 00000100:00100000:3.0:1788620265.805696:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044990208:12345-192.168.201.11@tcp:400:kworker.0 00000100:00080000:2.0:1788620265.805701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620265.805799:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504044990208:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 105us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620265.805807:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 109 00000100:00100000:1.0:1788620265.807206:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990080 00000100:00100000:1.0:1788620265.807217:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990080 00000100:00100000:1.0:1788620265.807313:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 276 00000100:00100000:1.0:1788620265.807323:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504044990080:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620265.807398:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504044990080:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 77us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620265.807406:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 276 00000100:00100000:2.0:1788620265.822558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620265.822602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620265.822749:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990336 00000100:00100000:1.0:1788620265.822760:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990336 00000100:00100000:1.0:1788620265.822886:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:1.0:1788620265.822898:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2352:x1875504044990336:12345-192.168.201.11@tcp:9:kworker.0 00000020:00000080:1.0:1788620265.822929:0:7779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0649 00000100:00080000:1.0:1788620265.822938:0:7779:0:(import.c:65:import_set_state_nolock()) ffffa0d666e94800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788620265.822976:0:7779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788620265.823302:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+2:2352:x1875504044990336:12345-192.168.201.11@tcp:9:kworker.0 Request processed in 405us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620265.823310:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00010000:00010000:0.0:1788620265.823462:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788620265.824237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620265.824486:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990464 00000100:00100000:3.0:1788620265.824496:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990464 00000100:00100000:3.0:1788620265.824662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 110 00000100:00100000:3.0:1788620265.824672:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504044990464:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620265.824759:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504044990464:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 89us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620265.824767:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 110 00000100:00080000:2.0:1788620265.825769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620266.346497:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061800704:0@lo:400:kworker.0 00000100:00100000:0.0:1788620266.346569:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620266.346640:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620266.346647:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061800832:0@lo:400:kworker.0 00000100:00100000:0.0:1788620266.346674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620266.346704:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800704 00000100:00100000:0.0:1788620266.346711:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800704 00000100:00100000:0.0:1788620266.346763:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788620266.346773:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620266.346827:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061800704:12345-0@lo:400:kworker.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620266.346834:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788620266.346870:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620266.346900:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061800704:0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347225:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061800448:0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620266.347312:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061800960:0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620266.347351:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788620266.347357:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061800576:0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620266.347396:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061801088:0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620266.347449:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800832 00000100:00100000:1.0:1788620266.347453:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800832 00000100:00100000:1.0:1788620266.347487:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801088 00000100:00100000:1.0:1788620266.347490:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801088 00000100:00100000:1.0:1788620266.347512:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788620266.347519:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347560:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061800832:12345-0@lo:400:kworker.0 Request processed in 41us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620266.347575:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788620266.347589:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788620266.347595:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347629:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061801088:12345-0@lo:400:kworker.0 Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620266.347634:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788620266.347651:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800960 00000100:00100000:1.0:1788620266.347654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800960 00000100:00100000:1.0:1788620266.347687:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800576 00000100:00100000:1.0:1788620266.347690:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800576 00000100:00100000:1.0:1788620266.347703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788620266.347708:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061800960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347737:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061800960:12345-0@lo:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620266.347742:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788620266.347753:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788620266.347758:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061800576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061800576:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620266.347787:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788620266.347806:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788620266.347810:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788620266.347812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620266.347830:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061800576:0@lo:400:kworker.0 00010000:00080000:1.0:1788620266.347842:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680327800 x1875504061801088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620266.347865:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061801088:0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347877:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061800960:0@lo:400:kworker.0 00000100:00100000:1.0:1788620266.347902:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061800832:0@lo:400:kworker.0 00000100:00100000:3.0:1788620266.352020:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061800448 00000100:00100000:3.0:1788620266.352035:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061800448 00000100:00100000:3.0:1788620266.352089:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788620266.352099:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061800448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620266.352219:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061800448:12345-0@lo:400:kworker.0 Request processed in 104us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620266.352268:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788620266.352369:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061800448:0@lo:400:kworker.0 00000100:00100000:3.0:1788620266.359930:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620266.359969:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061801216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620266.360049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620266.360366:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801216 00000100:00100000:0.0:1788620266.360376:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801216 00000100:00100000:0.0:1788620266.360434:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788620266.360445:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061801216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620266.360482:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788620266.360550:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061801216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620266.360557:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788620266.361088:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d680325180 x1875504061801216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620266.361109:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061801216:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788620266.476354:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:2.0:1788620266.476382:0:6712:0:(genops.c:885:class_export_put()) final put ffffa0d666e90800/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:0.0:1788620266.476479:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d666e90800/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a for lustre-OST0000 00000020:00000080:0.0:1788620266.476544:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d666e94800 for lustre-OST0000 00010000:00010000:0.0:1788620266.792532:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620266.857801:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061801344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620266.857882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620266.858384:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801344 00000100:00100000:0.0:1788620266.858392:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801344 00000100:00100000:0.0:1788620266.858449:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788620266.858459:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061801344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620266.858497:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620266.858606:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061801344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620266.858614:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788620266.859102:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061801344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620267.816666:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620268.840637:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620269.865239:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620270.888555:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620270.918353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620270.918406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620270.918447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620270.918546:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990592 00000100:00100000:1.0:1788620270.918557:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990592 00000100:00100000:1.0:1788620270.918615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 278 00000100:00100000:1.0:1788620270.918624:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044990592:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620270.918698:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504044990592:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 75us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620270.918706:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 278 00000100:00100000:0.0:1788620270.918859:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990848 00000100:00100000:0.0:1788620270.918864:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990848 00000100:00100000:0.0:1788620270.918908:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990720 00000100:00100000:0.0:1788620270.918912:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990720 00000100:00100000:0.0:1788620270.918933:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 114 00000100:00100000:0.0:1788620270.918954:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044990848:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620270.918986:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2355:x1875504044990848:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 33us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620270.918992:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 114 00000100:00100000:0.0:1788620270.919005:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00100000:0.0:1788620270.919011:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044990720:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620270.919044:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504044990720:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 32us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620270.919050:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00080000:1.0:1788620270.919456:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620271.475162:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061801600:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.475311:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061802112:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.475367:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788620271.475373:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061801472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620271.475402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.475422:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061801984:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.475470:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061801728:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475494:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.475510:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061802240:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.475562:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620271.475567:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061801856:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.475627:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801600 00000100:00100000:3.0:1788620271.475634:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801600 00000100:00100000:3.0:1788620271.475679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788620271.475689:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061801600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475739:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061801600:12345-0@lo:400:kworker.0 Request processed in 51us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620271.475747:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788620271.475778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061802112 00000100:00100000:3.0:1788620271.475782:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061802112 00000100:00100000:3.0:1788620271.475811:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801728 00000100:00100000:3.0:1788620271.475814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801728 00000100:00100000:3.0:1788620271.475825:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801856 00000100:00100000:3.0:1788620271.475827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801856 00000100:00100000:3.0:1788620271.475842:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788620271.475849:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061802112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475880:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061802112:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620271.475886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788620271.475898:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788620271.475903:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061801728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475934:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061801728:12345-0@lo:400:kworker.0 Request processed in 30us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620271.475940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788620271.475952:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788620271.475957:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061801856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.475984:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061801856:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620271.475998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788620271.476017:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801472 00000100:00100000:3.0:1788620271.476021:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801472 00000100:00100000:3.0:1788620271.476048:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788620271.476054:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061801472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620271.476095:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788620271.476127:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061801472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620271.476133:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788620271.476474:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061801856:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.476488:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061801728:0@lo:400:kworker.0 00010000:00080000:3.0:1788620271.476519:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d666e04700 x1875504061801472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620271.476536:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061801472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620271.476545:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061801600:0@lo:400:kworker.0 00000100:00100000:3.0:1788620271.476554:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061802112:0@lo:400:kworker.0 00000100:00100000:1.0:1788620271.477023:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061801984 00000100:00100000:1.0:1788620271.477030:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061801984 00000100:00100000:1.0:1788620271.477075:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061802240 00000100:00100000:1.0:1788620271.477078:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061802240 00000100:00100000:1.0:1788620271.477098:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788620271.477105:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061801984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620271.477158:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061801984:12345-0@lo:400:kworker.0 Request processed in 54us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620271.477177:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788620271.477191:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788620271.477197:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061802240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620271.477230:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061802240:12345-0@lo:400:kworker.0 Request processed in 34us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620271.477236:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788620271.477278:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620271.477282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788620271.477285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620271.477342:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061801984:0@lo:400:kworker.0 00010000:00080000:1.0:1788620271.477368:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d666e07100 x1875504061802240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788620287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620271.477377:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061802240:0@lo:400:kworker.0 00010000:00010000:3.0:1788620271.912718:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620271.976614:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620271.976639:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061802368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620271.976723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620271.976831:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061802368 00000100:00100000:3.0:1788620271.976840:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061802368 00000100:00100000:3.0:1788620271.976904:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788620271.976914:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061802368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620271.976949:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620271.977004:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061802368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620271.977017:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788620271.977690:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061802368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788620272.945207:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788620273.576876:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788620273.960607:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620274.984403:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620275.005519:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:57:53 (1788620273) 00010000:00010000:0.0:1788620276.008463:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620276.050694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620276.050785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620276.050829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620276.050862:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044991232 00000100:00100000:3.0:1788620276.050871:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044991232 00000100:00100000:3.0:1788620276.050927:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044991104 00000100:00100000:3.0:1788620276.050930:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044991104 00000100:00100000:3.0:1788620276.050954:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:3.0:1788620276.050965:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504044991232:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620276.051073:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504044991232:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 110us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620276.051082:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:3.0:1788620276.051099:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 120 00000100:00100000:3.0:1788620276.051106:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504044991104:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620276.051134:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504044991104:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620276.051153:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 120 00000100:00080000:3.0:1788620276.051170:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620276.051511:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044990976 00000100:00100000:2.0:1788620276.051517:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044990976 00000100:00100000:2.0:1788620276.051552:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 280 00000100:00100000:2.0:1788620276.051560:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504044990976:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620276.051604:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504044990976:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 45us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620276.051611:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 280 00000100:00100000:3.0:1788620276.365420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620276.367130:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044991360 00000100:00100000:0.0:1788620276.367145:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044991360 00000100:00100000:0.0:1788620276.367217:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:0.0:1788620276.367229:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:10215:x1875504044991360:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620276.367280:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620276.367304:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518e00/0x24857de440bd0714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22be expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.367369:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd071b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.367383:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd071b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.367395:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd071b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620276.367593:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788620276.367597:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620276.367710:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd071b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.367734:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518e00/0x24857de440bd0714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22be expref: 7 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.367750:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd071b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22be expref: 6 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.367758:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43500) 00010000:00010000:0.0:1788620276.367761:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620276.367765:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519c00, rc 0) 00000100:00100000:0.0:1788620276.367837:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:10215:x1875504044991360:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 610us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620276.367845:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:1.0:1788620276.378616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620276.378843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044991488 00000100:00100000:3.0:1788620276.378853:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044991488 00000100:00100000:3.0:1788620276.378922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:3.0:1788620276.378933:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:10216:x1875504044991488:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620276.378962:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620276.378997:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22c5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.379331:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.379346:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.379364:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.379380:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.379387:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.379394:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.383796:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd0737 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.384385:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd0737 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.384401:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd0737 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620276.385783:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788620276.385802:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620276.388222:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd0737 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388276:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388284:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388292:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388298:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620276.388303:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388310:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388326:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43500) 00010000:00010000:3.0:1788620276.388329:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620276.388334:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388339:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd0729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388353:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388359:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388378:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388383:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620276.388386:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388392:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388695:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0d65309e900) 00010000:00010000:3.0:1788620276.388699:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620276.388703:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.388709:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0730 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.389177:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22c5 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.389198:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd0737 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22c5 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620276.389205:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0d65309e600) 00010000:00010000:3.0:1788620276.389207:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620276.389210:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925200, rc 0) 00000100:00100000:3.0:1788620276.390363:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:10216:x1875504044991488:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 11425us (11750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620276.390390:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:3.0:1788620276.396718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620276.399386:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044991744 00000100:00100000:0.0:1788620276.399403:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044991744 00000100:00100000:0.0:1788620276.399526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:0.0:1788620276.399538:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:10216:x1875504044991744:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620276.399567:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620276.399591:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd073e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22cc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.399677:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.399710:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.399722:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.399785:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.399794:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.399800:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400419:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518e00/0x24857de440bd0753 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400429:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518e00/0x24857de440bd0753 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400437:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518e00/0x24857de440bd0753 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620276.400447:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788620276.400648:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400657:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400663:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400675:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620276.400680:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400687:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400699:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0d65309e600) 00010000:00010000:0.0:1788620276.400702:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620276.400706:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400713:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0745 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400726:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400732:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400739:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400744:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620276.400746:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400753:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400771:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0d642f43300) 00010000:00010000:0.0:1788620276.400774:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620276.400777:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.400783:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd074c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.401192:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd073e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22cc expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.401208:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518e00/0x24857de440bd0753 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22cc expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620276.401216:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:0.0:1788620276.401218:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620276.401221:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518e00, rc 0) 00000100:00100000:0.0:1788620276.401332:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:10216:x1875504044991744:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 1795us (4626us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788620276.401340:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:0.0:1788620276.413244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620276.413463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044991872 00000100:00100000:3.0:1788620276.413474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044991872 00000100:00100000:3.0:1788620276.413546:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:3.0:1788620276.413559:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:10216:x1875504044991872:12345-192.168.201.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788620276.413688:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:10216:x1875504044991872:12345-192.168.201.11@tcp:59:lhsmtool_posix.0 Request processed in 131us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620276.413696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:2.0:1788620276.584414:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061802496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620276.584486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620276.584544:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061802496 00000100:00100000:2.0:1788620276.584551:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061802496 00000100:00100000:2.0:1788620276.584603:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788620276.584612:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061802496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620276.584645:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788620276.584666:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061802752:0@lo:400:kworker.0 00000100:00100000:3.0:1788620276.584726:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061803008:0@lo:400:kworker.0 00000100:00100000:1.0:1788620276.585418:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061802880:0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.595935:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620276.596431:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061802752 00000100:00100000:0.0:1788620276.596442:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061802752 00000100:00100000:0.0:1788620276.596493:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788620276.596503:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061802752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.596594:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061802752:12345-0@lo:400:kworker.0 Request processed in 92us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620276.596602:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788620276.596642:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061802752:0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.596696:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061802624:0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.596729:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620276.596769:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061803136:0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.596792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620276.596891:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061802624 00000100:00100000:0.0:1788620276.596895:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061802624 00000100:00100000:0.0:1788620276.596925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788620276.596932:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061802624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.597077:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061802624:12345-0@lo:400:kworker.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620276.597086:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788620276.597115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061803136 00000100:00100000:0.0:1788620276.597119:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061803136 00000100:00100000:0.0:1788620276.598105:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788620276.598123:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061803136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.599134:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061803136:12345-0@lo:400:kworker.0 Request processed in 1014us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620276.599294:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788620276.599358:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061802624:0@lo:400:kworker.0 00000100:00100000:0.0:1788620276.599375:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061803136:0@lo:400:kworker.0 00000100:00100000:1.0:1788620276.600282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620276.600477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620276.600664:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061803008 00000100:00100000:1.0:1788620276.600796:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061803008 00000100:00100000:1.0:1788620276.600849:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788620276.600859:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061803008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620276.600908:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061803008:12345-0@lo:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620276.600924:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788620276.600965:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061803008:0@lo:400:kworker.0 00000100:00100000:1.0:1788620276.601132:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061802880 00000100:00100000:1.0:1788620276.601136:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061802880 00000100:00100000:1.0:1788620276.601174:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788620276.601181:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061802880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620276.601219:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061802880:12345-0@lo:400:kworker.0 Request processed in 38us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620276.601225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788620276.601281:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061802880:0@lo:400:kworker.0 00000100:00080000:1.0:1788620276.601317:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620276.601322:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788620276.601324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620276.607937:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061802496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 23314us (23439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620276.607952:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788620276.608110:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6809f7b80 x1875504061802496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620276.608134:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061802496:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788620276.649912:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788620276.659872:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1788620277.032814:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620277.096485:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620277.096507:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061803264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620277.096569:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620277.096657:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061803264 00000100:00100000:1.0:1788620277.096665:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061803264 00000100:00100000:1.0:1788620277.096714:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788620277.096723:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061803264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620277.096756:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620277.096801:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061803264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620277.096809:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788620277.096887:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061803264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788620278.056460:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620278.413118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.413301:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044992000 00000100:00100000:3.0:1788620278.413311:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044992000 00000100:00100000:3.0:1788620278.413386:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:3.0:1788620278.413398:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:10258:x1875504044992000:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620278.413429:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620278.413448:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0761 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22d3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788620278.413734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788620278.413868:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.413883:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.413906:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.413922:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.413929:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.413935:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414204:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414212:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414220:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414226:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620278.414230:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414239:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414544:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43500) 00010000:00010000:2.0:1788620278.414548:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620278.414553:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414567:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414579:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414585:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414591:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414597:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620278.414601:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414608:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414616:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620278.414619:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620278.414622:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414628:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd076f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414661:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0761 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22d3 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414685:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43500) 00010000:00010000:2.0:1788620278.414688:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620278.414692:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0761 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22d3 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.414703:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924c00, rc 0) 00000100:00100000:2.0:1788620278.414805:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:10258:x1875504044992000:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1410us (1697us total) trans 0 rc 301/301 00000100:00100000:2.0:1788620278.414813:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:3.0:1788620278.429492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620278.431036:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044992256 00000100:00100000:0.0:1788620278.431049:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044992256 00000100:00100000:0.0:1788620278.431114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:0.0:1788620278.431124:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:10258:x1875504044992256:12345-192.168.201.11@tcp:36:lfs.0 00010000:00010000:0.0:1788620278.431180:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620278.431208:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd071b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22be expref: 8 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.431225:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43500) 00010000:00010000:0.0:1788620278.431234:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620278.431546:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.431559:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.431570:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.431582:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.431588:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.431593:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620278.432576:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788620278.432593:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.432600:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.432607:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.432614:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620278.432618:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.432625:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.432636:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d642f43300) 00010000:00010000:0.0:1788620278.432639:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620278.432643:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.432649:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0776 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620278.432664:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000174e082f reply state 00000000b7097ea6 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620278.432672:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620278.432798:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:10258:x1875504044992256:12345-192.168.201.11@tcp:36:lfs.0 Request processed in 1672us (3325us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788620278.432807:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 37 00010000:00010000:2.0:1788620278.438567:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.438585:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.438593:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.438599:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620278.438604:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.438611:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.438628:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0d642f43400) 00010000:00010000:2.0:1788620278.438631:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620278.438635:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.438651:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd077d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620278.515514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.516886:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044992384 00000100:00100000:3.0:1788620278.516898:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044992384 00000100:00100000:3.0:1788620278.516980:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:3.0:1788620278.516990:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:10266:x1875504044992384:12345-192.168.201.11@tcp:101:lctl.0 00010000:00010000:3.0:1788620278.517017:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620278.517040:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.517110:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd078b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.517124:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd078b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.517136:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd078b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620278.517199:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788620278.517203:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620278.517244:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd078b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.517285:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22da expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.517320:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd078b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22da expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.517328:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:3.0:1788620278.517332:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620278.517335:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925c00, rc 0) 00000100:00100000:3.0:1788620278.517394:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:10266:x1875504044992384:12345-192.168.201.11@tcp:101:lctl.0 Request processed in 406us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620278.517401:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:3.0:1788620278.602538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620278.602742:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044992512 00000100:00100000:0.0:1788620278.602753:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044992512 00000100:00100000:0.0:1788620278.602812:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:0.0:1788620278.602821:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:10272:x1875504044992512:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620278.602841:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620278.602858:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.602921:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.602945:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.602958:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.602976:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.603000:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.603007:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603822:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd07a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603834:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd07a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603841:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd07a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620278.603875:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788620278.603880:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620278.603924:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd07a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603945:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603952:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603959:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603965:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620278.603970:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.603977:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604004:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:2.0:1788620278.604007:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620278.604013:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604019:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604034:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604040:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604046:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604050:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620278.604053:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604059:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604067:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0d642f43300) 00010000:00010000:2.0:1788620278.604069:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620278.604072:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd07a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604571:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e1 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604584:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd07a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e1 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.604590:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620278.604591:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788620278.604593:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3800, rc 0) 00000100:00100000:2.0:1788620278.604702:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:10272:x1875504044992512:12345-192.168.201.11@tcp:101:bash.0 Request processed in 1883us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620278.604720:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:1.0:1788620278.617836:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.618138:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044992768 00000100:00100000:3.0:1788620278.618149:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044992768 00000100:00100000:3.0:1788620278.618208:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 40 00000100:00100000:3.0:1788620278.618216:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:10272:x1875504044992768:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:3.0:1788620278.618237:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620278.618290:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd07ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22e8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.618425:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.618441:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.618471:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.618515:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.618522:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.618528:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788620278.619994:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788620278.621024:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621043:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621067:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621611:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621618:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621622:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621627:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620278.621630:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621636:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621646:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:1.0:1788620278.621648:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620278.621651:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.621655:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd07b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620278.621667:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb2b670d reply state 0000000091c04024 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620278.621673:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788620278.622223:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd07ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.622240:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.622246:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d64c7c2400) 00010000:00010000:1.0:1788620278.622287:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620278.622290:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620278.622364:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10272:x1875504044992768:12345-192.168.201.11@tcp:101:bash.0 Request processed in 4148us (4539us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788620278.622371:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 40 00000100:00100000:1.0:1788620278.628854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.629185:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044992896 00000100:00100000:3.0:1788620278.629195:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044992896 00000100:00100000:3.0:1788620278.629361:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:3.0:1788620278.629370:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875504044992896:12345-192.168.201.11@tcp:8:bash.0 00010000:00080000:3.0:1788620278.629410:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:3.0:1788620278.629709:0:6687:0:(genops.c:1385:class_connect()) connect: client 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a, cookie 0x24857de440bd07d1 00002000:00100000:3.0:1788620278.629824:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a/ffffa0d67a545000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788620278.629848:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788620278.630088:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00010000:2.0:1788620278.630238:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.630260:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.630268:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.630274:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620278.630278:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.630286:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.630302:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d65309eb00) 00010000:00010000:2.0:1788620278.630325:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620278.630331:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.630338:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd07bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788620278.630636:0:6687:0:(import.c:65:import_set_state_nolock()) ffffa0d67a542000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620278.630814:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2352:x1875504044992896:12345-192.168.201.11@tcp:8:bash.0 Request processed in 1442us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620278.630824:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:3.0:1788620278.636158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620278.636236:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044993024 00000100:00100000:0.0:1788620278.636277:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044993024 00000100:00100000:0.0:1788620278.636342:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:0.0:1788620278.636353:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:0:x1875504044993024:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620278.636371:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620278.636411:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22ef expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788620278.636440:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620278.636459:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1788620278.636464:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620278.636475:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.636501:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.636531:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519000, rc 0) 00000100:00100000:0.0:1788620278.636586:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:0:x1875504044993024:12345-192.168.201.11@tcp:101:bash.0 Request processed in 235us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620278.636593:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00080000:2.0:1788620278.639599:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620278.640082:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620278.640185:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044993152 00000100:00100000:1.0:1788620278.640196:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044993152 00000100:00100000:1.0:1788620278.640314:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:1.0:1788620278.640325:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:10272:x1875504044993152:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:1.0:1788620278.640346:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620278.640372:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22f6 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.640403:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.640412:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620278.640416:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620278.640420:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.640493:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.640509:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620278.640525:0:7779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1875504061803392:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620278.640623:0:7779:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620278.644170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620278.644277:0:7779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1875504061803392:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620278.644309:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.644329:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620278.644383:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:10272:x1875504044993152:12345-192.168.201.11@tcp:101:bash.0 Request processed in 4060us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620278.644392:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:2.0:1788620278.645876:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044993280 00000100:00100000:2.0:1788620278.645889:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044993280 00010000:00010000:2.0:1788620278.645930:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620278.646028:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:2.0:1788620278.646038:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504044993280:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620278.646051:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620278.646079:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.646094:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.646139:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd07d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22ef expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.646160:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620278.646164:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620278.646172:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.646197:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.646433:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620278.646585:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a068a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875504061803520:192.168.201.11@tcp:105: 00000100:00100000:2.0:1788620278.646667:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788620278.651982:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.652053:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044993536 00000100:00100000:3.0:1788620278.652063:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044993536 00000100:00100000:3.0:1788620278.652125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:3.0:1788620278.652135:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:10272:x1875504044993536:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:3.0:1788620278.652635:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10272:x1875504044993536:12345-192.168.201.11@tcp:35:bash.0 Request processed in 500us (662us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788620278.652643:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:2.0:1788620278.655352:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a068a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875504061803520:192.168.201.11@tcp:105: 00010000:00010000:2.0:1788620278.655378:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620278.655433:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504044993280:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 9396us (11272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620278.655463:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:1.0:1788620278.735858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.736151:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044993792 00000100:00100000:3.0:1788620278.736168:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044993792 00000100:00100000:3.0:1788620278.736379:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 41 00000100:00100000:3.0:1788620278.736393:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10282:x1875504044993792:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620278.736431:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620278.736459:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd07e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b22fd expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620278.736730:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788620278.736865:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd07e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22fd expref: 15 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.736881:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:3.0:1788620278.736885:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620278.736891:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd07e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22fd expref: 15 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.736904:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924200, rc 0) 00000100:00100000:3.0:1788620278.737035:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:10282:x1875504044993792:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 645us (1185us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788620278.737043:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 41 00000100:00100000:0.0:1788620278.739620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.739814:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044994048 00000100:00100000:3.0:1788620278.739825:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044994048 00000100:00100000:3.0:1788620278.745397:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:3.0:1788620278.745450:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:10282:x1875504044994048:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:3.0:1788620278.747367:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:10282:x1875504044994048:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 1918us (7743us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788620278.747381:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:0.0:1788620278.796656:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620278.796764:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044994176 00000100:00100000:2.0:1788620278.796774:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044994176 00000100:00100000:2.0:1788620278.796836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 42 00000100:00100000:2.0:1788620278.796856:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:10288:x1875504044994176:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620278.796884:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620278.796907:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd07f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2304 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.796983:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd07fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.796996:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd07fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.797021:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd07fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620278.797082:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788620278.797086:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620278.797127:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd07fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.797163:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd07f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2304 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.797182:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd07fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2304 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.797190:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620278.797193:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620278.797196:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3200, rc 0) 00000100:00100000:2.0:1788620278.797302:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:10288:x1875504044994176:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 457us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620278.797310:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 42 00000100:00100000:0.0:1788620278.808839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620278.809043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044994432 00000100:00100000:2.0:1788620278.809053:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044994432 00000100:00100000:2.0:1788620278.809119:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:2.0:1788620278.809129:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:10288:x1875504044994432:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620278.809152:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620278.809173:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b230b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.809334:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.809348:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.809360:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620278.809371:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788620278.809509:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b230b expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.809529:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b230b expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.809538:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d64c7c2400) 00010000:00010000:2.0:1788620278.809541:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620278.809544:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2c00, rc 0) 00000100:00100000:2.0:1788620278.809596:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10288:x1875504044994432:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 469us (767us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788620278.809604:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:0.0:1788620278.823984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620278.824138:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044994688 00000100:00100000:2.0:1788620278.824148:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044994688 00000100:00100000:2.0:1788620278.824218:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:2.0:1788620278.824229:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10288:x1875504044994688:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620278.824286:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620278.824319:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0817 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2312 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.824422:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd081e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.824437:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd081e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.824450:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd081e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620278.824463:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788620278.824582:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2312 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.824602:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd081e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2312 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.824611:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d64c7c2400) 00010000:00010000:2.0:1788620278.824614:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788620278.824617:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3e00, rc 0) 00000100:00100000:2.0:1788620278.824670:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:10288:x1875504044994688:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 443us (698us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788620278.824677:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:0.0:1788620278.834373:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620278.834529:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044994816 00000100:00100000:1.0:1788620278.834540:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044994816 00000100:00100000:1.0:1788620278.834609:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:1.0:1788620278.834619:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:2354:x1875504044994816:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620278.834634:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620278.834670:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b230b expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.834688:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d64c7c2400) 00010000:00010000:1.0:1788620278.834693:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620278.834763:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:2354:x1875504044994816:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 145us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620278.834771:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:3.0:1788620278.836045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620278.836883:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044994944 00000100:00100000:1.0:1788620278.836893:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044994944 00000100:00100000:1.0:1788620278.836960:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:1.0:1788620278.836970:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504044994944:12345-192.168.201.11@tcp:1:lfs.0 00010000:00010000:1.0:1788620278.837016:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.837037:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.837046:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620278.837050:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620278.837055:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.837089:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.837111:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 7 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620278.837139:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875504061803648:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620278.837218:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1788620278.843375:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620278.843525:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044995072 00000100:00100000:2.0:1788620278.843537:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044995072 00002000:00100000:2.0:1788620278.843583:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffffa0d649f20700 x1875504044995072/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:374/0 lens 504/0 e 0 to 0 dl 1788620289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788620278.843594:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d649f20700 with x1875504044995072 ext(0->12) 00010000:00010000:2.0:1788620278.843616:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 8 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.843631:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 8 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620278.843639:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d649f20700 00000100:00100000:2.0:1788620278.843673:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:2.0:1788620278.843682:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504044995072:12345-192.168.201.11@tcp:4:lfs.0 00000100:00100000:1.0:1788620278.844169:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875504061803648:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620278.844193:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788620278.879382:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000100:00100000:2.0:1788620278.880534:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504044995072:12345-192.168.201.11@tcp:4:lfs.0 Request processed in 36845us (37165us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788620278.880547:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00002000:00100000:2.0:1788620278.880561:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffffa0d649f20700 x1875504044995072/t4294967299(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:374/0 lens 504/448 e 0 to 0 dl 1788620289 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788620278.880572:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d649f20700 with x1875504044995072 ext(0->12) 00010000:00010000:2.0:1788620278.880583:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 9 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.880603:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 9 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620278.880612:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d649f20700 00000100:00100000:1.0:1788620278.884179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.884325:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044995200 00000100:00100000:3.0:1788620278.884335:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044995200 00010000:00010000:3.0:1788620278.884378:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 9 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620278.884458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:3.0:1788620278.884469:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2355:x1875504044995200:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620278.884487:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788620278.884520:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788620278.884523:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788620278 00002000:00010000:3.0:1788620278.884526:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788620278 00002000:00010000:3.0:1788620278.884528:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788620278 00010000:00010000:3.0:1788620278.884534:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 9 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.884549:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 9 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.884574:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd07df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22f6 expref: 9 pid: 7779 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.884610:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788620278.884615:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788620278.884621:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.884631:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620278.884661:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788620278.884781:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.884791:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.884815:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.884823:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.884830:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.884837:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620278.884842:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.885115:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.885133:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.885142:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd082c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620278.885209:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504044995200:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 739us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620278.885217:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:1.0:1788620278.885452:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504044994944:12345-192.168.201.11@tcp:1:lfs.0 Request processed in 48483us (49411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620278.885460:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:0.0:1788620278.888659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620278.888805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044995456 00000100:00100000:3.0:1788620278.888815:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044995456 00000100:00100000:1.0:1788620278.890166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:1.0:1788620278.890182:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:10288:x1875504044995456:12345-192.168.201.11@tcp:35:lfs.0 00000004:00010000:1.0:1788620278.890242:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd081e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2312 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788620278.890588:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788620278.890635:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788620278.892153:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788620278.892228:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.892245:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.892375:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.892420:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.892436:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 23 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620278.892451:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061803776:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620278.892649:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620278.909822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620278.914407:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061803776:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620278.914448:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620278.916820:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044995584 00000100:00100000:3.0:1788620278.916834:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044995584 00010000:00010000:2.0:1788620278.918487:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 24 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620278.918639:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:2.0:1788620278.918649:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:2355:x1875504044995584:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620278.918666:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620278.918674:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 24 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.918688:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 24 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.918711:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd07c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e8 expref: 24 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.918739:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d64c7c2400) 00010000:00010000:2.0:1788620278.918745:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.918754:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.918762:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.918796:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620278.918860:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:2355:x1875504044995584:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 213us (9067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620278.918953:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 37 00010000:00010000:1.0:1788620278.919017:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620278.919026:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788620278.919155:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788620278.919374:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788620278.919508:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061803904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788620278.919596:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620278.919627:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620278.921490:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061803904 00000100:00100000:3.0:1788620278.921564:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061803904 00000100:00100000:3.0:1788620278.921662:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620278.921671:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061803904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788620278.921789:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061803904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620278.921797:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620278.921958:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061803904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788620278.922761:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788620278.922841:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061804032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788620278.923031:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620278.923063:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664dbfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620278.923197:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061804032 00000100:00100000:1.0:1788620278.923204:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061804032 00000100:00100000:1.0:1788620278.923231:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620278.923238:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061804032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788620278.923408:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875504061804032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 169us (377us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788620278.923415:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620278.923490:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061804032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788620278.923606:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788620278.923640:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.923650:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.923657:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.923663:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620278.923668:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.923675:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.923689:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d64c7c2400) 00010000:00010000:0.0:1788620278.923692:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788620278.923696:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620278.923702:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0833 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620278.924035:0:5842:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:2.0:1788620278.924620:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1788620278.925029:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788620278.925042:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328963791836ns, next at 329963789215ns, rc = 0 00000001:00080000:1.0:1788620278.925053:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788620278.925096:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d64c7c2400) 00010000:00010000:1.0:1788620278.925100:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788620278.925170:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd081e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2312 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620278.925506:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:10288:x1875504044995456:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 35327us (36854us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788620278.925516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000020:00080000:1.0:1788620278.925523:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788620278.928168:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620278.931182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044995712 00000100:00100000:2.0:1788620278.931197:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044995712 00000100:00100000:2.0:1788620278.931420:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:2.0:1788620278.931432:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:10288:x1875504044995712:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620278.931456:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620278.931479:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd083a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2319 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.931554:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd083a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2319 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.931570:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd083a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2319 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620278.931591:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620278.931595:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620278.931598:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2400, rc 0) 00000100:00100000:2.0:1788620278.931701:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:10288:x1875504044995712:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 271us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620278.931708:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:1.0:1788620278.935651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620278.935706:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044995968 00000100:00100000:2.0:1788620278.935715:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044995968 00000100:00100000:2.0:1788620278.935769:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:2.0:1788620278.935780:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:10288:x1875504044995968:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620278.936029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:10288:x1875504044995968:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 250us (385us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788620278.936037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620279.061844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.062044:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044996224 00000100:00100000:2.0:1788620279.062066:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044996224 00000100:00100000:2.0:1788620279.062210:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:2.0:1788620279.062223:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:10298:x1875504044996224:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620279.062294:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620279.062318:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2320 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620279.062448:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788620279.062583:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0841 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2320 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.062598:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:2.0:1788620279.062602:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620279.062607:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2320 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.062620:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2200, rc 0) 00000100:00100000:2.0:1788620279.062685:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10298:x1875504044996224:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 465us (851us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788620279.062692:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:1.0:1788620279.073505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620279.073598:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044996352 00000100:00100000:3.0:1788620279.073610:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044996352 00000100:00100000:3.0:1788620279.073669:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:3.0:1788620279.073679:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10298:x1875504044996352:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:3.0:1788620279.073844:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074029:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074045:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074063:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074071:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074078:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074173:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074181:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074188:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788620279.074228:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074240:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074904:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074912:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074919:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620279.074933:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074942:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.074956:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:3.0:1788620279.074960:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620279.077140:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077153:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd084f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077179:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077186:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077193:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077199:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620279.077227:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077237:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077268:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d65309ea00) 00010000:00010000:3.0:1788620279.077271:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620279.077275:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077281:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077304:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077310:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077316:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077321:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620279.077324:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077330:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077338:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620279.077340:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620279.077348:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.077354:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd085d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620279.077460:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10298:x1875504044996352:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 3778us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620279.077470:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 47 00010000:00010000:1.0:1788620279.080956:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620279.089795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620279.089997:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044996608 00000100:00100000:1.0:1788620279.090010:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044996608 00000100:00100000:1.0:1788620279.090077:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:1.0:1788620279.090089:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10298:x1875504044996608:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:1.0:1788620279.090616:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+30:10298:x1875504044996608:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 528us (829us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788620279.090625:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620279.137084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620279.137149:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044996864 00000100:00100000:1.0:1788620279.137171:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044996864 00000100:00100000:1.0:1788620279.137229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:1.0:1788620279.137239:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+30:10301:x1875504044996864:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620279.137439:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620279.137460:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2327 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137528:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137541:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137552:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137565:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137572:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137577:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137696:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137704:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137710:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620279.137737:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788620279.137824:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137832:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137838:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137844:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620279.137848:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137855:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137875:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:1.0:1788620279.137879:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620279.137882:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137888:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd086b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137901:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137906:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137920:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137938:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620279.137941:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137947:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.137954:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d64c7c2400) 00010000:00010000:1.0:1788620279.137956:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620279.137958:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.138147:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.138188:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.138201:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.138208:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620279.138210:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620279.138213:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548c00, rc 0) 00000100:00100000:1.0:1788620279.138440:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:10301:x1875504044996864:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1202us (1367us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788620279.138456:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:3.0:1788620279.143166:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.143223:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044996992 00000100:00100000:2.0:1788620279.143234:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044996992 00000100:00100000:2.0:1788620279.143410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:2.0:1788620279.143432:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:10301:x1875504044996992:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:2.0:1788620279.143498:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143516:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143528:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143553:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143560:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143567:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143573:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620279.143576:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143584:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143595:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620279.143598:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620279.143602:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.143608:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620279.143766:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:10301:x1875504044996992:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 334us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620279.143775:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:3.0:1788620279.147184:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.149416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044997248 00000100:00100000:2.0:1788620279.149432:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044997248 00000100:00100000:2.0:1788620279.149497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:2.0:1788620279.149506:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:10301:x1875504044997248:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620279.149826:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+33:10301:x1875504044997248:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 320us (2651us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788620279.149834:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:0.0:1788620279.362887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.363534:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044997504 00000100:00100000:2.0:1788620279.363550:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044997504 00000100:00100000:2.0:1788620279.363693:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:2.0:1788620279.363705:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+33:10332:x1875504044997504:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:2.0:1788620279.363737:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620279.363762:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd088e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b232e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.363943:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.363960:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.363974:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620279.364011:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788620279.364215:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd088e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b232e expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.364236:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b232e expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.364246:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620279.364296:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620279.364300:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3a00, rc 0) 00000100:00100000:2.0:1788620279.364400:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10332:x1875504044997504:12345-192.168.201.11@tcp:101:cat.0 Request processed in 696us (1539us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788620279.364408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:3.0:1788620279.371235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.371364:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044997760 00000100:00100000:2.0:1788620279.371380:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044997760 00000100:00100000:3.0:1788620279.371409:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.371515:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:2.0:1788620279.371529:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10332:x1875504044997760:12345-192.168.201.11@tcp:35:cat.0 00000100:00100000:1.0:1788620279.371535:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044997888 00000100:00100000:1.0:1788620279.371542:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044997888 00000100:00100000:1.0:1788620279.371593:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:1.0:1788620279.371604:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+36:2355:x1875504044997888:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620279.371619:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620279.371654:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b232e expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.371679:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620279.371685:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620279.371774:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+36:2355:x1875504044997888:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 172us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620279.371783:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:2.0:1788620279.371829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10332:x1875504044997760:12345-192.168.201.11@tcp:35:cat.0 Request processed in 303us (610us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788620279.371838:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:3.0:1788620279.423382:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620279.423574:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044998144 00000100:00100000:0.0:1788620279.423586:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044998144 00000100:00100000:0.0:1788620279.423648:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:0.0:1788620279.423658:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10338:x1875504044998144:12345-192.168.201.11@tcp:101:dd.0 00010000:00010000:0.0:1788620279.423683:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620279.423687:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788620279.423728:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd07fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2304 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.423748:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620279.423753:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620279.423767:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd08a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2335 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.423863:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.423877:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.423885:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.423917:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.423958:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 35 pid: 5840 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620279.423972:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f816d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061804160:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620279.424052:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d644d2b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788620279.432540:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f816d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061804160:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620279.432572:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620279.432821:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620279.433550:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044998272 00000100:00100000:0.0:1788620279.433560:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044998272 00010000:00010000:0.0:1788620279.433601:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 36 pid: 5840 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620279.433642:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:0.0:1788620279.433652:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+36:2354:x1875504044998272:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620279.433668:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620279.433676:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 36 pid: 5840 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.433688:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 36 pid: 5840 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.433723:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2327 expref: 36 pid: 5840 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.433760:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:0.0:1788620279.433766:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.433775:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.433788:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.433814:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620279.433877:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:2354:x1875504044998272:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 226us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620279.433885:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 38 00010000:00010000:3.0:1788620279.437649:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.437667:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620279.437696:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788620279.442770:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd08a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 36 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.442799:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 35 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.442809:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620279.442812:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788620279.442828:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518200, rc 0) 00000100:00100000:3.0:1788620279.442894:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10338:x1875504044998144:12345-192.168.201.11@tcp:101:dd.0 Request processed in 19237us (19523us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788620279.442904:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:3.0:1788620279.452629:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620279.454291:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044998528 00000100:00100000:1.0:1788620279.454561:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044998528 00000100:00100000:2.0:1788620279.454869:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:2.0:1788620279.454879:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10338:x1875504044998528:12345-192.168.201.11@tcp:36:dd.0 00010000:00010000:2.0:1788620279.455158:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.455192:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.455204:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620279.455272:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788620279.455298:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d466ebf8 reply state 0000000001da3c25 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620279.455307:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620279.455414:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:10338:x1875504044998528:12345-192.168.201.11@tcp:36:dd.0 Request processed in 535us (2796us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788620279.455422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 52 00000020:00080000:2.0:1788620279.455427:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620279.457202:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.457218:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.457342:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.457491:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620279.457497:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.457505:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.457522:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620279.457525:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620279.457530:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.457537:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620279.734754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.735296:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044998656 00000100:00100000:2.0:1788620279.735307:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044998656 00000100:00100000:2.0:1788620279.735372:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:2.0:1788620279.735384:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:10352:x1875504044998656:12345-192.168.201.11@tcp:101:stat.0 00010000:00010000:2.0:1788620279.735412:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620279.735436:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd08bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b233c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735525:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735539:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735550:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735580:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735587:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735595:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735696:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735719:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 38 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735726:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735762:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 38 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.735775:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 38 pid: 8736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620279.735789:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a068a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061804288:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620279.736082:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788620279.740332:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a068a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061804288:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620279.740362:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620279.742019:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620279.742362:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044998912 00000100:00100000:0.0:1788620279.742373:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044998912 00000100:00100000:0.0:1788620279.742431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:0.0:1788620279.742450:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:5591:x1875504044998912:12345-192.168.201.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788620279.743012:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:5591:x1875504044998912:12345-192.168.201.11@tcp:35:ldlm_bl.0 Request processed in 571us (996us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788620279.743021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:1.0:1788620279.750552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620279.750657:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044999040 00000100:00100000:2.0:1788620279.750667:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044999040 00010000:00010000:2.0:1788620279.750721:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 40 pid: 8736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620279.750766:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:2.0:1788620279.750776:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:2355:x1875504044999040:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620279.750792:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620279.750799:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 40 pid: 8736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.750813:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 40 pid: 8736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.750838:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd08aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2335 expref: 40 pid: 8736 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.750856:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620279.750873:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.750883:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.750891:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.751329:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620279.751391:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:2355:x1875504044999040:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 616us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620279.751399:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 39 00010000:00010000:1.0:1788620279.753395:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753412:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620279.753471:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788620279.753589:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620279.753637:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753670:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753681:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753688:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753695:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753710:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620279.753715:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753722:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753736:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:1.0:1788620279.753739:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620279.753743:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753749:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd08c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753764:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753769:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753781:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753787:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620279.753790:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753796:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753803:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d647f7c600) 00010000:00010000:1.0:1788620279.753806:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620279.753809:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753814:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd08cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753857:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd08bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b233c expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753885:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b233c expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620279.753892:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620279.753895:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620279.753898:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3200, rc 0) 00000100:00100000:1.0:1788620279.754079:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:10352:x1875504044998656:12345-192.168.201.11@tcp:101:stat.0 Request processed in 18694us (19333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620279.754166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:1.0:1788620279.822159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620279.822506:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044999296 00000100:00100000:0.0:1788620279.822517:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044999296 00000100:00100000:0.0:1788620279.822822:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 54 00000100:00100000:0.0:1788620279.822834:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:10358:x1875504044999296:12345-192.168.201.11@tcp:36:truncate.0 00010000:00010000:0.0:1788620279.822888:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620279.823045:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd08d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b233c expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.823065:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:0.0:1788620279.823070:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620279.823533:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.823548:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620279.823558:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620279.823608:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788620279.823634:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051d34b44 reply state 000000007c284fbb transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620279.823644:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620279.823759:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:10358:x1875504044999296:12345-192.168.201.11@tcp:36:truncate.0 Request processed in 927us (1607us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788620279.823767:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 54 00000020:00080000:0.0:1788620279.823772:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788620279.825093:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.825108:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.825116:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.825122:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620279.825127:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.825135:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.825150:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620279.825153:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620279.825157:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620279.825163:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd08db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620279.972069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620279.977127:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044999424 00000100:00100000:3.0:1788620279.977155:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044999424 00000100:00100000:3.0:1788620279.977224:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:3.0:1788620279.977234:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:10372:x1875504044999424:12345-192.168.201.11@tcp:101:stat.0 00010000:00010000:3.0:1788620279.977268:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620279.977288:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd08e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2343 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977353:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977367:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977379:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977394:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977401:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977408:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977513:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977522:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977528:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620279.977567:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788620279.977570:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620279.977590:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977602:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977609:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977614:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977619:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977625:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620279.977629:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977636:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977647:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:3.0:1788620279.977649:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620279.977653:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977658:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd08e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977677:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977683:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977688:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977701:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620279.977704:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977709:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977715:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d65309ea00) 00010000:00010000:3.0:1788620279.977717:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620279.977720:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.977725:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd08f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.978120:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd08e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 41 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.978132:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 40 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620279.978150:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620279.978152:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620279.978154:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925800, rc 0) 00000100:00100000:3.0:1788620279.978217:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:10372:x1875504044999424:12345-192.168.201.11@tcp:101:stat.0 Request processed in 985us (6159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620279.978224:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:0.0:1788620280.077218:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.077406:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044999680 00000100:00100000:2.0:1788620280.077426:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044999680 00000100:00100000:2.0:1788620280.077515:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 56 00000100:00100000:2.0:1788620280.077527:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:10382:x1875504044999680:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620280.077563:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620280.077583:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd08fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b234a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620280.077702:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788620280.077829:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd08fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b234a expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.077843:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:2.0:1788620280.077845:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620280.077850:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd08fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b234a expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.077877:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3a00, rc 0) 00000100:00100000:2.0:1788620280.077945:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+41:10382:x1875504044999680:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 420us (737us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788620280.077952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 56 00000100:00080000:0.0:1788620280.079239:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620280.094711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.094814:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504044999936 00000100:00100000:2.0:1788620280.094823:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504044999936 00000100:00100000:2.0:1788620280.094888:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:2.0:1788620280.094898:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+41:10382:x1875504044999936:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620280.095199:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+42:10382:x1875504044999936:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 302us (497us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788620280.095207:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 14 00010000:00010000:2.0:1788620280.107549:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620280.174956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620280.175124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045000192 00000100:00100000:1.0:1788620280.175134:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045000192 00000100:00100000:1.0:1788620280.175193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 57 00000100:00100000:1.0:1788620280.175202:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+42:10388:x1875504045000192:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:1.0:1788620280.175227:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620280.175285:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd090c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2351 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.175393:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.175409:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 43 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.175418:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.175455:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 43 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.175468:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 43 pid: 8736 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620280.175481:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061804416:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620280.175793:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620280.190868:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061804416:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620280.190933:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620280.200705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.201338:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045000320 00000100:00100000:2.0:1788620280.201347:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045000320 00010000:00010000:2.0:1788620280.201387:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 44 pid: 8736 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620280.201431:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 40 00000100:00100000:2.0:1788620280.201442:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+44:2355:x1875504045000320:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620280.201457:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620280.201463:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 44 pid: 8736 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.201477:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 44 pid: 8736 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.201498:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd08f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2343 expref: 44 pid: 8736 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.201515:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.201521:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.201530:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.201536:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.201581:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620280.201636:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:2355:x1875504045000320:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 195us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.201644:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 40 00010000:00010000:1.0:1788620280.202381:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.202390:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620280.202408:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788620280.202547:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd090c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.202565:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.202571:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620280.202574:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788620280.202577:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620280.202614:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:10388:x1875504045000192:12345-192.168.201.11@tcp:101:bash.0 Request processed in 27413us (27669us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788620280.202620:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 57 00000100:00100000:3.0:1788620280.205484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.205556:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045000576 00000100:00100000:2.0:1788620280.205565:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045000576 00000100:00100000:2.0:1788620280.205615:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00100000:2.0:1788620280.205625:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:10388:x1875504045000576:12345-192.168.201.11@tcp:36:bash.0 00010000:00010000:2.0:1788620280.205863:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.205879:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.205889:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620280.205947:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788620280.205970:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f54cff57 reply state 000000001e600003 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620280.205978:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620280.206072:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:10388:x1875504045000576:12345-192.168.201.11@tcp:36:bash.0 Request processed in 448us (595us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788620280.206089:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 58 00000020:00080000:2.0:1788620280.206093:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620280.209533:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.209549:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.209557:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.209563:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620280.209568:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.209575:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.209590:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620280.209593:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620280.209597:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.209615:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0921 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620280.212589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.212684:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045000704 00000100:00100000:0.0:1788620280.212699:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045000704 00000100:00100000:0.0:1788620280.212759:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:0.0:1788620280.212769:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:10388:x1875504045000704:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620280.212815:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620280.212834:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2358 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.212921:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.212938:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.212947:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.212979:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.212992:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 46 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620280.213018:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f814e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061804544:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620280.213103:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664dbfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620280.215191:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f814e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061804544:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620280.215214:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620280.215432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.215503:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045000832 00000100:00100000:2.0:1788620280.215510:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045000832 00010000:00010000:2.0:1788620280.215539:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 47 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620280.215580:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 41 00000100:00100000:2.0:1788620280.215588:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:2356:x1875504045000832:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620280.215601:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620280.215607:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 47 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.215617:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 47 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.215637:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0913 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2351 expref: 47 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.215652:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.215656:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.215665:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.215672:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.215704:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620280.215755:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:2356:x1875504045000832:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 167us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.215763:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 41 00010000:00010000:0.0:1788620280.216323:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.216330:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620280.216368:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788620280.216372:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620280.216387:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.216408:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2358 expref: 46 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.216418:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2358 expref: 45 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.216423:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:0.0:1788620280.216425:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620280.216426:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519000, rc 0) 00000100:00100000:0.0:1788620280.216456:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:10388:x1875504045000704:12345-192.168.201.11@tcp:101:bash.0 Request processed in 3691us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620280.216461:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:3.0:1788620280.227651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.227717:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045001088 00000100:00100000:2.0:1788620280.227737:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045001088 00000100:00100000:2.0:1788620280.227784:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:2.0:1788620280.227800:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:10388:x1875504045001088:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:2.0:1788620280.228032:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:10388:x1875504045001088:12345-192.168.201.11@tcp:35:bash.0 Request processed in 234us (388us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788620280.228038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:2.0:1788620280.303358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.303438:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045001344 00000100:00100000:0.0:1788620280.303447:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045001344 00000100:00100000:0.0:1788620280.303502:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:0.0:1788620280.303510:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:10398:x1875504045001344:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620280.303530:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620280.303545:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b235f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620280.303636:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788620280.303780:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0936 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b235f expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.303815:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:0.0:1788620280.303818:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788620280.303823:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b235f expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.303837:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518400, rc 0) 00000100:00100000:0.0:1788620280.303913:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10398:x1875504045001344:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 395us (554us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788620280.303921:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:1.0:1788620280.307244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.307355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045001472 00000100:00100000:2.0:1788620280.307365:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045001472 00000100:00100000:2.0:1788620280.307408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:2.0:1788620280.307415:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10398:x1875504045001472:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:2.0:1788620280.307474:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307486:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307495:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307504:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307509:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307513:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307586:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307605:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307612:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620280.307650:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307659:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307664:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307668:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307672:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.307675:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307680:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307688:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620280.307699:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.307704:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307708:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307721:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307725:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307729:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307731:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.307733:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307736:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307740:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620280.307742:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.307743:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307746:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd094b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307755:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307758:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307762:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307768:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.307770:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307773:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307777:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.307778:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.307780:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.307783:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620280.307842:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10398:x1875504045001472:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 427us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.307847:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:3.0:1788620280.312481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.312549:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045001728 00000100:00100000:2.0:1788620280.312558:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045001728 00000100:00100000:2.0:1788620280.312607:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:2.0:1788620280.312615:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10398:x1875504045001728:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620280.312852:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+48:10398:x1875504045001728:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 237us (378us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788620280.312860:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:1.0:1788620280.362865:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.362945:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045001984 00000100:00100000:0.0:1788620280.362955:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045001984 00000100:00100000:0.0:1788620280.363047:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00100000:0.0:1788620280.363058:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+48:10401:x1875504045001984:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620280.363088:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620280.363118:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2366 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.363207:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.363227:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.363240:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.363295:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.363324:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.363331:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363507:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd096e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363516:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd096e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363524:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd096e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620280.363543:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788620280.363637:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363645:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363652:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363659:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620280.363663:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363670:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363693:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:1.0:1788620280.363697:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620280.363702:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363709:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0960 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363721:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363727:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363743:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363748:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620280.363751:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363758:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363765:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d642f43900) 00010000:00010000:1.0:1788620280.363768:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620280.363771:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363776:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.363988:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2366 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.364004:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd096e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2366 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.364012:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620280.364015:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620280.364017:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549800, rc 0) 00000100:00100000:1.0:1788620280.364144:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:10401:x1875504045001984:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1078us (1286us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788620280.364163:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00100000:1.0:1788620280.371062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620280.371149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.371238:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045002240 00000100:00100000:3.0:1788620280.371288:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045002240 00000100:00100000:3.0:1788620280.371376:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:3.0:1788620280.371386:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:2355:x1875504045002240:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620280.371403:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620280.371426:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd096e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2366 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.371446:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620280.371451:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620280.371509:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:2355:x1875504045002240:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 125us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620280.371517:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:2.0:1788620280.372446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045002112 00000100:00100000:2.0:1788620280.372454:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045002112 00000100:00100000:2.0:1788620280.372506:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 63 00000100:00100000:2.0:1788620280.372527:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:10401:x1875504045002112:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:2.0:1788620280.372584:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372598:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372618:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372647:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372655:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372662:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372667:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.372672:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372679:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372766:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.372770:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620280.372774:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.372781:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd097c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620280.373005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:10401:x1875504045002112:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 479us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.373014:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 63 00000100:00100000:1.0:1788620280.376439:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.376515:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045002496 00000100:00100000:2.0:1788620280.376524:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045002496 00000100:00100000:2.0:1788620280.376577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:2.0:1788620280.376586:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:10401:x1875504045002496:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620280.377017:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:10401:x1875504045002496:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 429us (584us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788620280.377025:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:3.0:1788620280.453630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620280.453778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045002752 00000100:00100000:1.0:1788620280.453788:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045002752 00000100:00100000:1.0:1788620280.453963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:1.0:1788620280.453977:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:10419:x1875504045002752:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:1.0:1788620280.454000:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620280.454021:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b236d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.454183:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd098a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.454197:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd098a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.454207:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd098a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620280.454218:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788620280.454373:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b236d expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.454391:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd098a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b236d expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.454418:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620280.454420:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788620280.454424:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620280.454524:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10419:x1875504045002752:12345-192.168.201.11@tcp:101:cat.0 Request processed in 550us (906us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788620280.454530:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:1.0:1788620280.480529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.480649:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045002880 00000100:00100000:0.0:1788620280.480659:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045002880 00000100:00100000:0.0:1788620280.480761:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:0.0:1788620280.480771:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10420:x1875504045002880:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620280.480796:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620280.480816:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2374 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.480893:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd099f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.480923:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd099f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.480934:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd099f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620280.480991:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1788620280.480995:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620280.481016:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd099f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.481041:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2374 expref: 54 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.481086:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd099f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2374 expref: 53 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.481093:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620280.481096:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620280.481100:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518400, rc 0) 00000100:00100000:0.0:1788620280.481161:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10420:x1875504045002880:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 391us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620280.481168:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:3.0:1788620280.485035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.485205:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045003264 00000100:00100000:0.0:1788620280.485215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045003264 00000100:00100000:0.0:1788620280.485294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:0.0:1788620280.485303:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10420:x1875504045003264:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620280.485806:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10420:x1875504045003264:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 502us (781us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788620280.485814:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:3.0:1788620280.488790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.488955:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045003392 00000100:00100000:2.0:1788620280.488964:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045003392 00000100:00100000:2.0:1788620280.489046:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620280.489058:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10420:x1875504045003392:12345-192.168.201.11@tcp:103:lfs.0 00010000:00010000:2.0:1788620280.489072:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788620280.489098:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd092f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2358 expref: 54 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.489120:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd098a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b236d expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.489133:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd083a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2319 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.489143:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.489167:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620280.489225:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:10420:x1875504045003392:12345-192.168.201.11@tcp:103:lfs.0 Request processed in 169us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.489233:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:1.0:1788620280.494874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.494960:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045003520 00000100:00100000:2.0:1788620280.494969:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045003520 00000100:00100000:2.0:1788620280.495028:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 66 00000100:00100000:2.0:1788620280.495038:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:10420:x1875504045003520:12345-192.168.201.11@tcp:58:lfs.0 00010000:00010000:2.0:1788620280.495170:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.495185:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.495198:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620280.495502:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620280.495678:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788620280.495751:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788620280.495851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:10420:x1875504045003520:12345-192.168.201.11@tcp:58:lfs.0 Request processed in 814us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.495859:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 66 00000100:00100000:1.0:1788620280.511570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.511667:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045003648 00000100:00100000:2.0:1788620280.511677:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045003648 00000100:00100000:2.0:1788620280.511746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 67 00000100:00100000:2.0:1788620280.511757:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:10422:x1875504045003648:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620280.511778:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620280.511798:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b237b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.511879:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.511894:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.511917:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.511932:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.511939:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.511946:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512041:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512050:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512057:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620280.512103:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788620280.512107:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620280.512126:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512148:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512156:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512162:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512169:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512174:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.512178:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512186:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512197:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620280.512200:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.512204:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512210:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512224:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512230:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512240:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512245:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.512286:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512293:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512302:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.512304:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.512307:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512313:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512343:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512356:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.512363:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620280.512365:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620280.512368:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2c00, rc 0) 00000100:00100000:2.0:1788620280.512419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10422:x1875504045003648:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 664us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.512433:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 67 00000040:00080000:2.0:1788620280.744532:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788620280.744542:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788620280.744605:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788620280.744613:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788620280.744754:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a068e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061804672:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788620280.744873:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620280.761879:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a068e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061804672:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788620280.763940:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.764351:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045003776 00000100:00100000:3.0:1788620280.764362:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045003776 00000100:00100000:3.0:1788620280.764431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:3.0:1788620280.764441:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10434:x1875504045003776:12345-192.168.201.11@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788620280.764532:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10434:x1875504045003776:12345-192.168.201.11@tcp:900:lhsmtool_posix.0 Request processed in 92us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620280.764539:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:1.0:1788620280.768356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.768658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045003904 00000100:00100000:3.0:1788620280.768667:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045003904 00000100:00100000:3.0:1788620280.768729:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:3.0:1788620280.768738:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10434:x1875504045003904:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788620280.768766:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788620280.768870:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10434:x1875504045003904:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 133us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620280.768878:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:3.0:1788620280.784410:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.784656:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045004032 00000100:00100000:2.0:1788620280.784667:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045004032 00000100:00100000:2.0:1788620280.784730:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:2.0:1788620280.784740:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10434:x1875504045004032:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788620280.784814:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.784831:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.784857:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.784932:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.784941:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.784948:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.784992:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785000:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785007:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620280.785043:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788620280.785047:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620280.785062:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785072:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785078:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785085:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785091:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.785095:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785103:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785114:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:2.0:1788620280.785122:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.785128:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785134:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd09c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785147:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785154:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785159:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785164:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.785167:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785173:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785180:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.785183:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.785185:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785191:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd09d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785205:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785216:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785221:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785226:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.785229:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785235:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785243:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620280.785245:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620280.785278:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.785285:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd09d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620280.785349:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10434:x1875504045004032:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 Request processed in 610us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.785357:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:3.0:1788620280.789338:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.789619:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045004288 00000100:00100000:2.0:1788620280.789630:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045004288 00000100:00100000:2.0:1788620280.789699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:2.0:1788620280.789709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10434:x1875504045004288:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620280.789730:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620280.789765:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd09de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2382 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.789876:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.789890:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.790178:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620280.790191:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788620280.790328:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.790337:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.790344:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.790350:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620280.790354:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.790362:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.790373:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620280.790376:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620280.790381:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.790397:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd09e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.791100:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd09de lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2382 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.791113:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:2.0:1788620280.791116:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620280.791121:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd09de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2382 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.791131:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3e00, rc 0) 00000100:00100000:2.0:1788620280.791200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10434:x1875504045004288:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 1491us (1871us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788620280.791208:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:1.0:1788620280.801994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.802159:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045004416 00000100:00100000:2.0:1788620280.802172:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045004416 00000100:00100000:2.0:1788620280.802237:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 71 00000100:00100000:2.0:1788620280.802281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10434:x1875504045004416:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788620280.802316:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788620280.802448:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10434:x1875504045004416:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 202us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.802456:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 71 00000100:00100000:3.0:1788620280.818143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.818192:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045004672 00000100:00100000:3.0:1788620280.818202:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045004672 00000100:00100000:3.0:1788620280.818268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 72 00000100:00100000:3.0:1788620280.818279:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10434:x1875504045004672:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620280.818299:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620280.818302:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788620280.818328:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd099f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2374 expref: 53 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.818346:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:3.0:1788620280.818361:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620280.818374:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd09f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2389 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788620280.820528:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788620280.821596:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd09fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.821614:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd09fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.821626:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd09fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.822317:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd09f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2389 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.822339:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd09fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2389 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.822348:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620280.822351:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620280.822354:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924200, rc 0) 00000100:00100000:3.0:1788620280.824342:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10434:x1875504045004672:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 4139us (4283us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788620280.824360:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 72 00000100:00100000:1.0:1788620280.835817:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.835889:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045004928 00000100:00100000:3.0:1788620280.835909:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045004928 00000100:00100000:3.0:1788620280.835968:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 73 00000100:00100000:3.0:1788620280.835978:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10434:x1875504045004928:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788620280.836062:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620280.836100:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd09fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2389 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836119:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620280.836132:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620280.836154:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836167:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836178:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836220:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836229:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836237:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836705:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836714:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836720:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836732:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620280.836737:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836745:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836754:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:3.0:1788620280.836757:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620280.836762:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836768:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836778:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836784:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836790:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836796:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620280.836799:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836805:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836823:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x78aaa80b (ffffa0d65309ed00) 00010000:00010000:3.0:1788620280.836825:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620280.836828:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.836834:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78aaa80b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620280.837056:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10434:x1875504045004928:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 1079us (1248us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620280.837064:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 73 00000100:00100000:1.0:1788620280.847606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.847686:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045005056 00000100:00100000:2.0:1788620280.847696:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045005056 00000100:00100000:2.0:1788620280.847771:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 74 00000100:00100000:2.0:1788620280.847792:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10434:x1875504045005056:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620280.847813:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620280.847835:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0a16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2390 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.847874:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.847887:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.847911:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.848011:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 55 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.848027:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 54 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620280.848035:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620280.848038:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788620280.848042:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3a00, rc 0) 00000100:00100000:2.0:1788620280.848117:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10434:x1875504045005056:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 327us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.848124:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 74 00000100:00100000:1.0:1788620280.855017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.855204:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045005312 00000100:00100000:3.0:1788620280.855215:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045005312 00000100:00100000:3.0:1788620280.855295:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:3.0:1788620280.855306:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10434:x1875504045005312:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788620280.855387:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.855404:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.855416:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620280.855689:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788620280.855701:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330894450924ns, next at 331894448671ns, rc = 0 00000004:00010000:3.0:1788620280.855782:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d75d326 reply state 0000000085605b9e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620280.855805:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620280.855910:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10434:x1875504045005312:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 593us (890us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788620280.855918:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 75 00010000:00010000:3.0:1788620280.857830:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.857847:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.857854:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.857860:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620280.857865:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.857873:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.857889:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620280.857892:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788620280.857909:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.857915:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620280.869909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.869977:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045005440 00000100:00100000:0.0:1788620280.869987:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045005440 00000100:00100000:0.0:1788620280.870045:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 76 00000100:00100000:0.0:1788620280.870056:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10434:x1875504045005440:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620280.870088:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620280.870108:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2397 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.870166:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 56 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.870190:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 56 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620280.870211:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:0.0:1788620280.870215:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620280.870218:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518800, rc 0) 00000100:00100000:0.0:1788620280.870288:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10434:x1875504045005440:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 234us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620280.870295:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 76 00000100:00100000:3.0:1788620280.877759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.877841:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045005568 00000100:00100000:0.0:1788620280.877850:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045005568 00000100:00100000:0.0:1788620280.877912:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:0.0:1788620280.877920:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875504045005568:12345-192.168.201.11@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788620280.877970:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:0.0:1788620280.878003:0:6687:0:(genops.c:1385:class_connect()) connect: client 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a, cookie 0x24857de440bd0a32 00002000:00100000:0.0:1788620280.878015:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a/ffffa0d649cd1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788620280.878038:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788620280.878282:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788620280.878312:0:6687:0:(import.c:65:import_set_state_nolock()) ffffa0d649cd2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620280.878386:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2352:x1875504045005568:12345-192.168.201.11@tcp:8:lhsmtool_posix.0 Request processed in 464us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620280.878393:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:1.0:1788620280.880917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620280.881024:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045005696 00000100:00100000:0.0:1788620280.881034:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045005696 00000100:00100000:0.0:1788620280.881128:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 25 00000100:00100000:0.0:1788620280.881138:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:0:x1875504045005696:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788620280.881532:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620280.922393:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:0:x1875504045005696:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 41245us (41472us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788620280.922406:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 25 00000001:00080000:2.0:1788620280.924450:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788620280.924465:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000100:00100000:0.0:1788620280.929563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620280.930542:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045005952 00000100:00100000:1.0:1788620280.930553:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045005952 00000100:00100000:1.0:1788620280.930611:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:1.0:1788620280.930620:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10434:x1875504045005952:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788620280.930853:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10434:x1875504045005952:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 234us (1297us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788620280.930859:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:2.0:1788620280.939816:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.939867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045006208 00000100:00100000:2.0:1788620280.939877:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045006208 00000100:00100000:2.0:1788620280.939939:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 77 00000100:00100000:2.0:1788620280.939949:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10434:x1875504045006208:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788620280.941873:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10434:x1875504045006208:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 1919us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.941886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 77 00000100:00100000:3.0:1788620280.949608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.949665:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045006336 00000100:00100000:3.0:1788620280.949675:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045006336 00000100:00100000:3.0:1788620280.949729:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 78 00000100:00100000:3.0:1788620280.949740:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10434:x1875504045006336:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620280.949762:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620280.950200:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b239e expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.950294:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.951094:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.951112:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620280.952941:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620280.952978:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.953021:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b239e expref: 59 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.953039:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b239e expref: 58 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.953049:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620280.953052:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788620280.953056:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924400, rc 0) 00000100:00100000:3.0:1788620280.953194:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:10434:x1875504045006336:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 3453us (3592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620280.953203:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 78 00000100:00100000:0.0:1788620280.963049:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.963464:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045006464 00000100:00100000:3.0:1788620280.963476:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045006464 00000100:00100000:3.0:1788620280.963534:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 26 00000100:00100000:3.0:1788620280.963545:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504045006464:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620280.963564:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620280.963587:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23a5 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620280.963614:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2df8, blocks: 0x1 00010000:00010000:3.0:1788620280.963633:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1788620280.963638:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620280.963647:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.963668:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.963683:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924200, rc 0) 00000100:00100000:3.0:1788620280.963740:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504045006464:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 196us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620280.963748:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 26 00000100:00100000:2.0:1788620280.969495:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620280.969531:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045006720 00000100:00100000:2.0:1788620280.969540:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045006720 00000100:00100000:2.0:1788620280.969588:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:2.0:1788620280.969598:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:10434:x1875504045006720:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788620280.969694:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:10434:x1875504045006720:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 97us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620280.969702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:3.0:1788620280.972263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.972296:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045006848 00000100:00100000:3.0:1788620280.972313:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045006848 00000100:00100000:3.0:1788620280.972361:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:3.0:1788620280.972371:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:10434:x1875504045006848:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620280.972387:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620280.972405:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23ac expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.972435:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.972445:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788620280.972449:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620280.972455:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.972488:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.972500:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 7 pid: 6687 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620280.972513:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875504061804800:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620280.972600:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620280.989245:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620280.989313:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875504061804800:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620280.989349:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620280.989391:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924c00, rc 0) 00000100:00100000:3.0:1788620280.989455:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:10434:x1875504045006848:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 17085us (17211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620280.989463:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045006976 00000100:00100000:3.0:1788620280.989464:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:1.0:1788620280.989471:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045006976 00010000:00010000:1.0:1788620280.989503:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 7 pid: 6687 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620280.989541:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 42 00000100:00100000:1.0:1788620280.989549:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045006976:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620280.989562:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620280.989584:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 7 pid: 6687 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.989598:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 7 pid: 6687 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.989628:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ebe7283/0x24857de440bd0a47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23a5 expref: 7 pid: 6687 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.989643:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620280.989647:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620280.989655:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.989678:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620280.989712:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620280.989726:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875504061804928:192.168.201.11@tcp:105: 00000100:00100000:1.0:1788620280.989791:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583add80 going to sleep for 11 seconds 00000100:00100000:2.0:1788620281.005729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.005831:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875504061804928:192.168.201.11@tcp:105: 00010000:00010000:0.0:1788620281.005856:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620281.005870:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045007104 00000100:00100000:3.0:1788620281.005877:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045007104 00000100:00100000:0.0:1788620281.005923:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045006976:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 16374us (16687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.005934:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 42 00002000:00100000:3.0:1788620281.005943:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0d67a069c00 x1875504045007104/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:377/0 lens 504/0 e 0 to 0 dl 1788620292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620281.005952:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d67a069c00 with x1875504045007104 ext(0->8) 00002000:00010000:3.0:1788620281.005957:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d67a069c00 00000100:00100000:3.0:1788620281.005981:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:3.0:1788620281.005990:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504045007104:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788620281.006601:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504045007104:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 Request processed in 611us (882us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788620281.006609:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00002000:00100000:3.0:1788620281.006614:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0d67a069c00 x1875504045007104/t4294967302(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:377/0 lens 504/448 e 0 to 0 dl 1788620292 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620281.006623:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d67a069c00 with x1875504045007104 ext(0->8) 00002000:00010000:3.0:1788620281.006626:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d67a069c00 00000100:00100000:2.0:1788620281.013185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.013787:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045007232 00000100:00100000:3.0:1788620281.013799:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045007232 00000100:00100000:3.0:1788620281.013851:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 80 00000100:00100000:3.0:1788620281.013860:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:10434:x1875504045007232:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1788620281.129644:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620281.177869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.177999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.178097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620281.180911:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045007616 00000100:00100000:1.0:1788620281.180927:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045007616 00000100:00100000:1.0:1788620281.181192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 124 00000100:00100000:1.0:1788620281.181205:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045007616:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620281.181717:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045007616:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 104us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620281.181727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 124 00000100:00080000:1.0:1788620281.181752:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620281.181904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045007360 00000100:00100000:0.0:1788620281.181910:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045007360 00000100:00100000:0.0:1788620281.181941:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 282 00000100:00100000:0.0:1788620281.181950:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045007360:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620281.181982:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045007360:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 33us (4124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.181988:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 282 00000100:00100000:3.0:1788620281.182992:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045007488 00000100:00100000:3.0:1788620281.183011:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045007488 00000100:00100000:3.0:1788620281.183058:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00100000:3.0:1788620281.183077:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045007488:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620281.183275:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045007488:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 199us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.183284:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00080000:1.0:1788620281.185433:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620281.190875:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:10434:x1875504045007232:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 Request processed in 177004us (177686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.190898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 80 00000001:00080000:3.0:1788620281.190937:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:3.0:1788620281.190955:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788620281.190979:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d650819480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788620281.190983:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d64844f300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d64973da80 00000020:00080000:3.0:1788620281.190987:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d64844fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d6819c9c00 00000001:00080000:3.0:1788620281.191001:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:0.0:1788620281.191284:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620281.191301:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061805056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788620281.191352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620281.191417:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061805056 00000100:00100000:0.0:1788620281.191424:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061805056 00000100:00100000:0.0:1788620281.191470:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788620281.191478:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061805056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788620281.191502:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788620281.191533:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c2df6, atime: 0x6a9c2df6, ctime: 0x6a9c2df6, blocks: 0x1 00010000:00010000:0.0:1788620281.191541:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788620281.191550:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788620281.191587:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:0.0:1788620281.191632:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1788620281.191637:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620281.191644:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.191660:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.191670:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.191678:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788620281.191692:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1788620281.191694:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620281.192376:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620281.192384:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.192393:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620281.192398:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.192407:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875504061805056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 928us (1053us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788620281.192415:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1788620281.192418:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.192434:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.192440:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009927f680/0x24857de440bd0a55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.192455:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620281.192457:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620281.192458:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788620281.192467:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620281.192520:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061805184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1788620281.192548:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d67f815500/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788620281.192552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620281.192553:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061805056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788620281.192581:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061805184 00000100:00100000:3.0:1788620281.192585:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061805184 00000100:00100000:3.0:1788620281.192619:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788620281.192627:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061805184:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788620281.193359:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788620281.196617:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788620281.196627:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788620280 00002000:00010000:3.0:1788620281.196630:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788620281.196631:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788620280 -> 1788620280 00002000:00010000:3.0:1788620281.196633:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788620281.196731:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061805184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4101us (4173us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788620281.196742:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788620281.196795:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d680b51500/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788620281.196803:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061805184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788620281.197820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620281.197933:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045007744 00000100:00100000:1.0:1788620281.197942:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045007744 00000100:00100000:1.0:1788620281.198004:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 30 00000100:00100000:1.0:1788620281.198014:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2354:x1875504045007744:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788620281.301917:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788620281.301932:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788620281.301992:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504045007744:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 Request processed in 103967us (104163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620281.302003:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 30 00000100:00100000:1.0:1788620281.308141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.308227:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045008000 00000100:00100000:0.0:1788620281.308237:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045008000 00000100:00100000:0.0:1788620281.308319:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 81 00000100:00100000:0.0:1788620281.308330:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10434:x1875504045008000:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620281.308384:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620281.308421:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b239e expref: 13 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.308440:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:0.0:1788620281.308446:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620281.308476:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.308489:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.308501:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620281.308742:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c959b9c reply state 00000000cdd747af transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.308753:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620281.308865:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:10434:x1875504045008000:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 537us (740us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788620281.308873:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 81 00010000:00010000:2.0:1788620281.325572:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.325614:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.325623:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.325630:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620281.325637:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.325645:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.325664:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620281.325668:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620281.325673:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.325680:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0a5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620281.326923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.327281:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045008128 00000100:00100000:3.0:1788620281.327292:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045008128 00000100:00100000:3.0:1788620281.327351:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:3.0:1788620281.327360:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504045008128:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788620281.327587:0:7779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788620281.327591:0:7779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788620280 -> 1788620279 00002000:00010000:3.0:1788620281.327593:0:7779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788620278 00002000:00010000:3.0:1788620281.327596:0:7779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788620280 -> 1788620279 00002000:00010000:3.0:1788620281.327598:0:7779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788620281.327663:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045008128:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 303us (746us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788620281.327671:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:3.0:1788620281.336427:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.336509:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045008384 00000100:00100000:2.0:1788620281.336519:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045008384 00000100:00100000:2.0:1788620281.336578:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:2.0:1788620281.336588:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10434:x1875504045008384:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788620281.336664:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.336681:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 13 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.336702:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.336737:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 13 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.336751:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 13 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620281.336767:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a068380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061805312:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620281.336859:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680824900 going to sleep for 11 seconds 00000100:00100000:1.0:1788620281.343963:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a068380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061805312:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620281.344000:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.345430:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.345711:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045008512 00000100:00100000:0.0:1788620281.345721:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045008512 00010000:00010000:0.0:1788620281.345762:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.345812:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:0.0:1788620281.345820:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:2356:x1875504045008512:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620281.345834:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620281.345841:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.345858:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.345899:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0a1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2390 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.345914:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:0.0:1788620281.345919:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.345929:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.345936:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.345967:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620281.346025:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2356:x1875504045008512:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 205us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.346033:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 43 00010000:00010000:1.0:1788620281.346094:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346102:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346139:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346146:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346153:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346158:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620281.346162:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346171:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346180:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620281.346183:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788620281.346187:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.346193:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0a63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620281.348976:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:10434:x1875504045008384:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 Request processed in 12377us (12547us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788620281.349005:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:1.0:1788620281.361442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.361571:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045008640 00000100:00100000:3.0:1788620281.361581:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045008640 00000100:00100000:3.0:1788620281.361648:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:3.0:1788620281.361658:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045008640:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788620281.361701:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.361723:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.361732:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620281.361737:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788620281.361741:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.361775:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.361789:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 7 pid: 6689 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.361804:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061805440:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620281.361894:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620281.364948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620281.365017:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045008768 00000100:00100000:1.0:1788620281.365027:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045008768 00010000:00010000:1.0:1788620281.365067:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 8 pid: 6689 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620281.365110:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:1.0:1788620281.365120:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504045008768:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620281.365145:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620281.365168:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 8 pid: 6689 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.365179:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 8 pid: 6689 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.365204:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620281.365209:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620281.365215:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.365225:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.365245:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620281.365320:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504045008768:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 201us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620281.365341:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 44 00010000:00010000:3.0:1788620281.365662:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aae8034/0x24857de440bd0a4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ac expref: 7 pid: 6689 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.365678:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061805440:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620281.365700:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365716:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365723:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365745:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365752:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365760:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365766:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620281.365770:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365780:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365791:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.365810:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf697934/0x24857de440bd0a6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.365869:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045008640:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 Request processed in 4213us (4438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.365878:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:2.0:1788620281.375086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.375145:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045009024 00000100:00100000:2.0:1788620281.375156:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045009024 00000100:00100000:2.0:1788620281.375213:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 83 00000100:00100000:2.0:1788620281.375224:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:10434:x1875504045009024:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788620281.375321:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.375338:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.375350:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.375576:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.375591:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 13 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.375599:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.375634:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 13 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.375648:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 13 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620281.375662:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a06bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061805568:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620281.375748:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680824540 going to sleep for 11 seconds 00000100:00100000:3.0:1788620281.380977:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620281.380994:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a06bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061805568:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620281.381023:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045009152 00000100:00100000:3.0:1788620281.381031:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045009152 00010000:00010000:1.0:1788620281.381035:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.381078:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.381119:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:3.0:1788620281.381135:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:2355:x1875504045009152:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620281.381151:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620281.381157:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.381169:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.381191:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0a2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2397 expref: 14 pid: 8736 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.381208:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620281.381226:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.381236:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.381243:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.381287:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620281.381343:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2355:x1875504045009152:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 209us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.381351:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 45 00010000:00010000:1.0:1788620281.381808:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.381817:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788620281.382021:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788620281.382194:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788620281.382237:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788620281.382347:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875504061805696:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788620281.382419:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620281.382453:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583add80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620281.382829:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061805696 00000100:00100000:3.0:1788620281.382836:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061805696 00000100:00100000:3.0:1788620281.382901:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620281.382909:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875504061805696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788620281.382992:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875504061805696:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.383000:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620281.383050:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788620281.383055:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d680b51500, transno 4294967303 00000100:00100000:3.0:1788620281.383079:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875504061805696:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788620281.383576:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788620281.384446:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875504061805824:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788620281.384502:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620281.384534:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788620281.384577:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061805824 00000100:00100000:1.0:1788620281.384583:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061805824 00000100:00100000:1.0:1788620281.384618:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620281.384626:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875504061805824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788620281.384822:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875504061805824:12345-0@lo:1000:mdt00_002.0 Request processed in 195us (318us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788620281.384829:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620281.387816:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5841:1875504061805824:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788620281.387880:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.387902:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.387910:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.387917:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.387923:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.387931:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.387947:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620281.387951:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620281.387956:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.387962:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0a78 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389122:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389137:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389145:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389164:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.389169:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389177:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389190:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:3.0:1788620281.389193:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620281.389198:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389204:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd09a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389231:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389273:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389282:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389322:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.389339:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 16 pid: 5839 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.389366:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061805952:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620281.389461:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788620281.392656:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.392830:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061805952:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620281.392855:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.397843:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045009280 00000100:00100000:0.0:1788620281.397864:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045009280 00010000:00010000:0.0:1788620281.397924:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 17 pid: 5839 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.398848:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:0.0:1788620281.398863:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:2356:x1875504045009280:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620281.398899:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620281.398909:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 17 pid: 5839 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.398925:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 17 pid: 5839 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.398948:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd09c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b237b expref: 17 pid: 5839 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.398963:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:0.0:1788620281.398968:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.398988:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.398996:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.399032:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788620281.399086:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399095:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.399100:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:2356:x1875504045009280:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 242us (6455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.399108:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 46 00010000:00010000:1.0:1788620281.399113:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399119:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399125:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399131:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620281.399135:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399152:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399162:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:1.0:1788620281.399164:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620281.399168:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0a7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399186:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399192:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399198:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399209:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620281.399212:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399219:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399227:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:1.0:1788620281.399229:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788620281.399232:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.399238:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0a71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620281.399460:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:10434:x1875504045009024:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 24236us (24383us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788620281.399469:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 83 00000020:00080000:1.0:1788620281.399472:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788620281.401167:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620281.401176:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620281.401219:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788620281.401225:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788620281.409836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.409944:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045009536 00000100:00100000:0.0:1788620281.409954:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045009536 00000100:00100000:0.0:1788620281.410394:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:0.0:1788620281.410407:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:10434:x1875504045009536:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788620281.411615:0:5843:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788620281.411805:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788620281.411865:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.411894:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.411909:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.411919:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.411932:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.411938:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.412066:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:1.0:1788620281.412067:0:11996:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788620281.412073:0:11996:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788620281.412106:0:11996:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788620281.412112:0:11996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788620281.412178:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:10434:x1875504045009536:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 1772us (2349us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788620281.412187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 20 00000020:00080000:2.0:1788620281.412193:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788620281.418753:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620281.418769:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.418780:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620281.418785:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.418795:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.418815:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0d647f7c300) 00010000:00010000:0.0:1788620281.418818:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788620281.418824:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.418830:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0a86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.419032:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620281.419035:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620281.419037:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620281.557440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620281.557533:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045009792 00000100:00100000:1.0:1788620281.557543:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045009792 00000100:00100000:1.0:1788620281.557601:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 84 00000100:00100000:1.0:1788620281.557612:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:10444:x1875504045009792:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620281.557648:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620281.557685:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0a8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23b3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.558045:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0a94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.558061:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.558084:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620281.558095:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788620281.558389:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23b3 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.558408:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23b3 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.558418:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:1.0:1788620281.558421:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788620281.558425:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549800, rc 0) 00000100:00100000:1.0:1788620281.558478:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:10444:x1875504045009792:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 868us (1049us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788620281.558487:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 84 00000100:00100000:3.0:1788620281.561521:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.568274:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045009920 00000100:00100000:2.0:1788620281.568291:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045009920 00000100:00100000:2.0:1788620281.568361:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 85 00000100:00100000:2.0:1788620281.568372:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:10444:x1875504045009920:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:2.0:1788620281.568451:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568467:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568479:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568493:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568500:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568518:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568819:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568827:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568834:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620281.568872:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568895:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568901:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568909:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568915:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620281.568919:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568927:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568940:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620281.568950:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620281.568955:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568962:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0aa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568973:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568979:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568985:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568990:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620281.568993:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.568999:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569007:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d647f7c000) 00010000:00010000:2.0:1788620281.569009:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620281.569012:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569019:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569032:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569045:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569051:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569056:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620281.569060:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569066:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569074:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:2.0:1788620281.569076:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620281.569079:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.569085:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620281.569178:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:10444:x1875504045009920:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 806us (7664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620281.569189:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 85 00000100:00100000:2.0:1788620281.619479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.619583:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045010176 00000100:00100000:3.0:1788620281.619594:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045010176 00000100:00100000:3.0:1788620281.619655:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 86 00000100:00100000:3.0:1788620281.619673:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:10447:x1875504045010176:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620281.619694:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620281.619713:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.619781:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.619795:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.619817:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.619847:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.619855:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.619862:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620200:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620210:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620218:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620281.620228:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788620281.620343:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620351:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620357:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620364:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.620369:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620387:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620400:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:3.0:1788620281.620404:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620281.620409:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620416:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0abe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620430:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620436:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620442:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620447:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.620450:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620456:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620464:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d65309ea00) 00010000:00010000:3.0:1788620281.620467:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620281.620470:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620485:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620527:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620541:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.620550:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620281.620552:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620281.620554:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680925800, rc 0) 00000100:00100000:3.0:1788620281.620616:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:10447:x1875504045010176:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 951us (1146us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788620281.620624:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 86 00000100:00100000:0.0:1788620281.636681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.636723:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045010304 00000100:00100000:0.0:1788620281.636732:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045010304 00000100:00100000:0.0:1788620281.636783:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 87 00000100:00100000:0.0:1788620281.636794:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:10447:x1875504045010304:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:0.0:1788620281.636892:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.636910:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.636923:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.636959:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.636967:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.636974:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.636982:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620281.636986:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.636995:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.637007:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:0.0:1788620281.637010:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788620281.637014:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.637020:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.642277:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:10447:x1875504045010304:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 5457us (5592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.642294:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 87 00000100:00100000:2.0:1788620281.652944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.652993:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045010560 00000100:00100000:2.0:1788620281.653005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045010560 00000100:00100000:2.0:1788620281.653056:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:2.0:1788620281.653067:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:10447:x1875504045010560:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620281.653366:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:10447:x1875504045010560:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 299us (438us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788620281.653376:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:0.0:1788620281.693150:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.693364:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045010816 00000100:00100000:3.0:1788620281.693375:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045010816 00000100:00100000:3.0:1788620281.693429:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 88 00000100:00100000:3.0:1788620281.693438:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:9975:x1875504045010816:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:3.0:1788620281.693462:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620281.693481:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0ae1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.693588:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.693603:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.693627:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.693662:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.693675:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 23 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.693690:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061806080:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620281.693775:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620281.697530:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061806080:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620281.697559:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.700714:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620281.701339:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045010944 00000100:00100000:1.0:1788620281.701350:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045010944 00010000:00010000:1.0:1788620281.701401:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 24 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620281.701529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:1.0:1788620281.701540:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:2356:x1875504045010944:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620281.701556:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620281.701562:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 24 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.701575:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 24 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.701598:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0acc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23ba expref: 24 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.701613:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:1.0:1788620281.701619:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.701628:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.701635:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.701674:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620281.701740:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:2356:x1875504045010944:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 201us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620281.701747:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 47 00010000:00010000:0.0:1788620281.702421:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.702439:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620281.702458:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788620281.702618:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0ae1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.702635:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.702645:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:0.0:1788620281.702648:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788620281.702651:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924c00, rc 0) 00000100:00100000:0.0:1788620281.702716:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:9975:x1875504045010816:12345-192.168.201.11@tcp:101:bash.0 Request processed in 9277us (9576us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788620281.702725:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 88 00000100:00100000:3.0:1788620281.707511:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620281.707537:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061806208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620281.707612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620281.707761:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061806208 00000100:00100000:2.0:1788620281.707769:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061806208 00000100:00100000:2.0:1788620281.707830:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788620281.707840:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875504061806208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620281.707876:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620281.707928:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875504061806208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620281.707935:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788620281.708148:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061806208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620281.708524:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061806720:0@lo:400:kworker.0 00000100:00100000:3.0:1788620281.708558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620281.708581:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788620281.708586:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061806592:0@lo:400:kworker.0 00000100:00100000:3.0:1788620281.708606:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620281.708633:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061806720 00000100:00100000:3.0:1788620281.708644:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061806720 00000100:00100000:0.0:1788620281.708757:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061806336:0@lo:400:kworker.0 00000100:00100000:0.0:1788620281.708795:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620281.708900:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620281.708907:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061806464:0@lo:400:kworker.0 00000100:00100000:0.0:1788620281.708933:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620281.708961:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061806592 00000100:00100000:0.0:1788620281.708965:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061806592 00000100:00100000:0.0:1788620281.709069:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061806464 00000100:00100000:0.0:1788620281.709073:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061806464 00000100:00100000:0.0:1788620281.709087:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788620281.709094:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061806592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620281.709145:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061806592:12345-0@lo:400:kworker.0 Request processed in 51us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.709152:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788620281.709167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788620281.709173:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061806464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620281.709202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061806464:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.709209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788620281.709226:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061806336 00000100:00100000:0.0:1788620281.709229:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061806336 00000100:00100000:0.0:1788620281.709268:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788620281.709274:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061806336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620281.709303:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061806336:12345-0@lo:400:kworker.0 Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.709309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788620281.709347:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061806464:0@lo:400:kworker.0 00000100:00100000:0.0:1788620281.709355:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061806336:0@lo:400:kworker.0 00000100:00100000:3.0:1788620281.710306:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788620281.710317:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061806720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620281.710358:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061806720:12345-0@lo:400:kworker.0 Request processed in 45us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.710362:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788620281.710383:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620281.710401:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061806592:0@lo:400:kworker.0 00000100:00100000:3.0:1788620281.710409:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061806720:0@lo:400:kworker.0 00000100:00100000:0.0:1788620281.710606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.716501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045011200 00000100:00100000:2.0:1788620281.716517:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045011200 00000100:00100000:0.0:1788620281.721201:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 89 00000100:00100000:0.0:1788620281.721216:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:9975:x1875504045011200:12345-192.168.201.11@tcp:36:bash.0 00010000:00010000:0.0:1788620281.721509:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.721524:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.721552:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620281.721603:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788620281.721629:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004802c965 reply state 000000009eab3d58 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.721638:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788620281.721684:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788620281.721787:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:9975:x1875504045011200:12345-192.168.201.11@tcp:36:bash.0 Request processed in 574us (11180us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788620281.721795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 89 00000020:00080000:0.0:1788620281.721811:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788620281.724572:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.724605:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.724612:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.724619:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620281.724624:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.724632:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.724649:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:1.0:1788620281.724652:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620281.724657:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620281.724663:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0af6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.732895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.733029:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045011328 00000100:00100000:3.0:1788620281.733039:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045011328 00000100:00100000:3.0:1788620281.733102:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 90 00000100:00100000:3.0:1788620281.733113:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:9975:x1875504045011328:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:3.0:1788620281.733140:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620281.733160:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0afd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23c8 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.733224:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0afd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c8 expref: 27 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.733240:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0afd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c8 expref: 27 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.733299:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620281.733303:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620281.733310:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d680924600, rc 0) 00000100:00100000:3.0:1788620281.733369:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:9975:x1875504045011328:12345-192.168.201.11@tcp:101:bash.0 Request processed in 258us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.733390:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 90 00000100:00100000:3.0:1788620281.736244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.736339:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045011456 00000100:00100000:0.0:1788620281.736348:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045011456 00000100:00100000:0.0:1788620281.736397:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:0.0:1788620281.736408:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:9975:x1875504045011456:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620281.736426:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620281.736446:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23cf expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788620281.736467:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c2df7, atime: 0x6a9c2df6, ctime: 0x6a9c2df7, blocks: 0xb 00010000:00010000:0.0:1788620281.736483:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1788620281.736487:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620281.736493:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.736514:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.736524:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519800, rc 0) 00000100:00100000:0.0:1788620281.736574:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:9975:x1875504045011456:12345-192.168.201.11@tcp:101:bash.0 Request processed in 170us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.736579:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:1.0:1788620281.738746:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.738838:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045011584 00000100:00100000:2.0:1788620281.738849:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045011584 00002000:00010000:2.0:1788620281.738895:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788620281.738900:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d680b52a00 with x1875504045011584 ext(0->18446744073709551615) 00002000:00010000:2.0:1788620281.738911:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d680b52a00. 00000100:00100000:2.0:1788620281.738943:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:2.0:1788620281.738953:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045011584:12345-192.168.201.11@tcp:10:bash.0 00002000:00010000:2.0:1788620281.739211:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788620281.739214:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788620279 -> 1788620281 00002000:00010000:2.0:1788620281.739216:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788620278 -> 1788620278 00002000:00010000:2.0:1788620281.739218:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788620279 -> 1788620281 00002000:00010000:2.0:1788620281.739220:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788620281.739434:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504045011584:12345-192.168.201.11@tcp:10:bash.0 Request processed in 483us (709us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788620281.739454:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 1 00002000:00010000:2.0:1788620281.739456:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788620281.739458:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d680b52a00 with x1875504045011584 ext(0->18446744073709551615) 00002000:00010000:2.0:1788620281.739462:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d680b52a00. 00000100:00100000:2.0:1788620281.799615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.799754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045011712 00000100:00100000:0.0:1788620281.799764:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045011712 00000100:00100000:0.0:1788620281.799837:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 91 00000100:00100000:0.0:1788620281.799848:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:10461:x1875504045011712:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:0.0:1788620281.799941:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.799962:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.799975:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.799993:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800001:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800008:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800346:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800355:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800362:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620281.800400:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800410:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800416:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800422:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800429:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620281.800433:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800440:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800451:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620281.800454:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620281.800458:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800469:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800481:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800486:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800492:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800497:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620281.800500:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800505:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800511:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d642f43000) 00010000:00010000:0.0:1788620281.800513:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620281.800516:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800521:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800532:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800538:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800547:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800563:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620281.800566:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800572:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800580:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:0.0:1788620281.800583:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620281.800586:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.800592:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.800659:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:10461:x1875504045011712:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 812us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620281.800667:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 91 00000100:00100000:0.0:1788620281.837078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620281.837291:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045011968 00000100:00100000:3.0:1788620281.837300:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045011968 00000100:00100000:3.0:1788620281.837348:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 92 00000100:00100000:3.0:1788620281.837358:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:10464:x1875504045011968:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620281.837375:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620281.837393:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0b20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23d6 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837461:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837475:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837488:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837502:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837507:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837513:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837832:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd0b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837853:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.837872:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd0b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620281.837991:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788620281.838079:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838087:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838093:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838098:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.838103:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838110:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838122:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:3.0:1788620281.838125:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620281.838130:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838136:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925800/0x24857de440bd0b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838149:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838161:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838167:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838172:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680924400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.838175:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838181:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838189:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d65309ea00) 00010000:00010000:3.0:1788620281.838191:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620281.838194:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838201:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924400/0x24857de440bd0b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838616:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924200/0x24857de440bd0b20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23d6 expref: 30 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838634:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd0b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23d6 expref: 29 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.838642:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620281.838644:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788620281.838652:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642000, rc 0) 00000100:00100000:2.0:1788620281.838896:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10464:x1875504045011968:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1538us (1827us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788620281.838905:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 92 00000100:00100000:1.0:1788620281.842957:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.843145:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045012096 00000100:00100000:0.0:1788620281.843155:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045012096 00000100:00100000:0.0:1788620281.843214:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 93 00000100:00100000:0.0:1788620281.843224:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10464:x1875504045012096:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:0.0:1788620281.843315:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.843347:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.843356:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.843410:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.843424:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 29 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620281.843438:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061806848:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620281.843526:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620281.846834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.847010:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061806848:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620281.847035:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.847339:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045012352 00000100:00100000:3.0:1788620281.847347:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045012352 00000100:00100000:3.0:1788620281.847401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:3.0:1788620281.847410:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+30:5590:x1875504045012352:12345-192.168.201.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788620281.847948:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:5590:x1875504045012352:12345-192.168.201.11@tcp:35:ldlm_bl.0 Request processed in 536us (1120us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788620281.847956:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:3.0:1788620281.850768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.850916:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045012480 00000100:00100000:2.0:1788620281.850926:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045012480 00010000:00010000:2.0:1788620281.850965:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 31 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620281.851007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:2.0:1788620281.851018:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:2356:x1875504045012480:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620281.851032:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620281.851039:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 31 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.851052:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 31 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.851096:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924c00/0x24857de440bd0ae8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c1 expref: 31 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.851114:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:2.0:1788620281.851120:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.851130:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.851137:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.851177:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620281.851236:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+30:2356:x1875504045012480:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 219us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620281.851243:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 48 00010000:00010000:3.0:1788620281.851815:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851824:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851856:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851874:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851907:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851914:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.851918:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851926:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851948:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620281.851950:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620281.851954:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.851960:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620281.852016:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10464:x1875504045012096:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 8792us (9350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620281.852023:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 93 00000100:00100000:0.0:1788620281.856817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.856946:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045012736 00000100:00100000:2.0:1788620281.856956:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045012736 00000100:00100000:2.0:1788620281.857007:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:2.0:1788620281.857017:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:10464:x1875504045012736:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620281.857277:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+30:10464:x1875504045012736:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 260us (472us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788620281.857285:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:1.0:1788620281.958013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620281.958164:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045012992 00000100:00100000:0.0:1788620281.958174:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045012992 00000100:00100000:0.0:1788620281.958236:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 94 00000100:00100000:0.0:1788620281.958245:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+30:10475:x1875504045012992:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:0.0:1788620281.958301:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620281.958320:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23dd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958385:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958413:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958424:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958438:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958445:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958451:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958907:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958917:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.958924:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620281.958934:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788620281.959020:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959027:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959033:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959044:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620281.959184:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959193:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959205:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620281.959208:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620281.959213:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959220:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959232:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959237:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959243:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959330:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620281.959334:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959341:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959359:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d642f43000) 00010000:00010000:0.0:1788620281.959361:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620281.959364:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959370:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959412:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23dd expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959424:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23dd expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620281.959430:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:0.0:1788620281.959433:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620281.959435:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518400, rc 0) 00000100:00100000:0.0:1788620281.959540:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:10475:x1875504045012992:12345-192.168.201.11@tcp:101:cat.0 Request processed in 1294us (1535us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788620281.959556:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 94 00000100:00100000:1.0:1788620281.968505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.968586:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045013248 00000100:00100000:2.0:1788620281.968597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045013248 00000100:00100000:2.0:1788620281.968652:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:2.0:1788620281.968798:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:10475:x1875504045013248:12345-192.168.201.11@tcp:35:cat.0 00000100:00100000:2.0:1788620281.969277:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+33:10475:x1875504045013248:12345-192.168.201.11@tcp:35:cat.0 Request processed in 480us (781us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788620281.969285:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:1.0:1788620281.985994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620281.986214:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045013504 00000100:00100000:2.0:1788620281.986225:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045013504 00000100:00100000:2.0:1788620281.986318:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 95 00000100:00100000:2.0:1788620281.986328:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+33:10476:x1875504045013504:12345-192.168.201.11@tcp:36:rm.0 00010000:00010000:2.0:1788620281.986388:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788620281.986417:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23dd expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986440:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd0b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23d6 expref: 32 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986452:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680924600/0x24857de440bd0afd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23c8 expref: 31 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986462:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:2.0:1788620281.986474:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620281.986496:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986509:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986519:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986717:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986727:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.986734:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.987151:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.987161:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.987169:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620281.988410:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788620281.988420:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332027169750ns, next at 333027167451ns, rc = 0 00010000:00010000:2.0:1788620281.988487:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.988500:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.988508:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.988516:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.988534:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.988541:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989028:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620281.989061:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989069:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989075:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989081:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620281.989085:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989093:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989104:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620281.989107:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788620281.989111:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989118:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989136:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989149:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989156:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989161:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620281.989164:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989170:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989177:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620281.989180:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620281.989182:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.989188:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620281.989198:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000216d6b20 reply state 00000000678cc796 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620281.989207:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620281.989344:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:10476:x1875504045013504:12345-192.168.201.11@tcp:36:rm.0 Request processed in 3013us (3357us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788620281.989352:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 95 00010000:00010000:3.0:1788620281.992634:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620281.992646:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.992713:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620281.992719:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.992730:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.992747:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620281.992750:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788620281.992754:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.992760:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0b82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.993234:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.993244:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.993267:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.993272:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620281.993276:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.993283:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.993291:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d647f7c200) 00010000:00010000:3.0:1788620281.993294:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620281.993297:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620281.993303:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0b74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620281.994990:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620281.994996:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620281.995013:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620282.048514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.048928:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045013760 00000100:00100000:2.0:1788620282.048939:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045013760 00000100:00100000:2.0:1788620282.049005:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 96 00000100:00100000:2.0:1788620282.049016:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:10482:x1875504045013760:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:2.0:1788620282.049057:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.049079:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23e4 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.049204:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.049218:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.049228:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.049242:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.049276:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.049284:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788620282.049827:0:8736:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788620282.050015:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050025:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050040:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050075:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050083:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050090:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050095:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620282.050099:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050107:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050119:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620282.050122:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620282.050126:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050133:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0b90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620282.050145:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097503544 reply state 00000000f808270b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.050153:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788620282.050187:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0b89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 34 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050202:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 33 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.050209:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:2.0:1788620282.050212:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620282.050214:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3200, rc 0) 00000100:00100000:2.0:1788620282.050316:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:10482:x1875504045013760:12345-192.168.201.11@tcp:101:bash.0 Request processed in 1302us (1812us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788620282.050324:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 96 00000100:00080000:3.0:1788620282.050650:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788620282.052851:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.052886:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.052910:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.052916:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620282.052920:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.052928:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.052943:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d647f7c400) 00010000:00010000:3.0:1788620282.052946:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620282.052950:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.052957:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0b97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620282.055929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.056136:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045013888 00000100:00100000:2.0:1788620282.056146:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045013888 00000100:00100000:2.0:1788620282.056201:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:2.0:1788620282.056211:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045013888:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:2.0:1788620282.056229:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.056270:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23eb expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620282.056296:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620282.056313:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1788620282.056317:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620282.056325:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.056344:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.056369:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3a00, rc 0) 00000100:00100000:2.0:1788620282.056421:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2353:x1875504045013888:12345-192.168.201.11@tcp:101:bash.0 Request processed in 211us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.056427:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:1.0:1788620282.059981:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620282.060200:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045014016 00000100:00100000:3.0:1788620282.060209:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045014016 00000100:00100000:3.0:1788620282.060335:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:3.0:1788620282.060346:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:10482:x1875504045014016:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:3.0:1788620282.060365:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620282.060381:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23f2 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.060410:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.060437:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620282.060440:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620282.060446:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 9 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.060478:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.060492:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 9 pid: 6689 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620282.060505:0:7779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1875504061806976:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620282.060597:0:7779:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620282.066414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620282.066515:0:7779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1875504061806976:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620282.066557:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 9 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.066578:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643600, rc 0) 00000100:00100000:3.0:1788620282.066630:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:10482:x1875504045014016:12345-192.168.201.11@tcp:101:bash.0 Request processed in 6285us (6658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.066640:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:2.0:1788620282.067029:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045014144 00000100:00100000:2.0:1788620282.067037:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045014144 00010000:00010000:2.0:1788620282.067076:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 9 pid: 6689 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.067110:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:2.0:1788620282.067120:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2355:x1875504045014144:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620282.067133:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620282.067153:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 9 pid: 6689 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.067167:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 9 pid: 6689 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.067187:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ec97784/0x24857de440bd0bac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23eb expref: 9 pid: 6689 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.067200:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620282.067204:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620282.067212:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.067228:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.067289:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.067303:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a06ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1875504061807104:192.168.201.11@tcp:105: 00000100:00100000:2.0:1788620282.067351:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680824480 going to sleep for 11 seconds 00000100:00100000:2.0:1788620282.072365:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a06ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1875504061807104:192.168.201.11@tcp:105: 00010000:00010000:2.0:1788620282.072394:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620282.072484:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504045014144:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 5365us (6078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.072495:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:1.0:1788620282.073488:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.074284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045014400 00000100:00100000:2.0:1788620282.074294:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045014400 00000100:00100000:2.0:1788620282.074348:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 25 00000100:00100000:2.0:1788620282.074358:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+33:10482:x1875504045014400:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:2.0:1788620282.075385:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:10482:x1875504045014400:12345-192.168.201.11@tcp:35:bash.0 Request processed in 1024us (1895us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788620282.075394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 25 00010000:00010000:1.0:1788620282.152563:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620282.217287:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061807232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620282.217364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620282.217526:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061807232 00000100:00100000:1.0:1788620282.217534:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061807232 00000100:00100000:1.0:1788620282.217587:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788620282.217596:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061807232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620282.217627:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620282.217858:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061807232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 262us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620282.218038:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061807232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620282.218145:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788620282.224858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.225126:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045014528 00000100:00100000:2.0:1788620282.225136:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045014528 00000100:00100000:2.0:1788620282.225196:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 97 00000100:00100000:2.0:1788620282.225205:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:10498:x1875504045014528:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620282.225271:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.225291:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0bba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b23f9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.225348:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.225361:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.225371:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620282.225425:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788620282.225428:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620282.225447:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.225468:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f9 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.225485:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f9 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.225494:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620282.225497:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620282.225500:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2200, rc 0) 00000100:00100000:2.0:1788620282.225556:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10498:x1875504045014528:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 352us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.225563:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 97 00000100:00100000:1.0:1788620282.233664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.233770:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045014784 00000100:00100000:2.0:1788620282.233780:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045014784 00000100:00100000:2.0:1788620282.233837:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 98 00000100:00100000:2.0:1788620282.233846:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:10498:x1875504045014784:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620282.233884:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.233912:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2400 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.234023:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.234037:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.234058:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620282.234069:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788620282.234199:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2400 expref: 38 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.234218:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2400 expref: 37 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.234226:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:2.0:1788620282.234229:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620282.234232:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2600, rc 0) 00000100:00100000:2.0:1788620282.234345:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:10498:x1875504045014784:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 499us (700us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788620282.234370:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 98 00000100:00100000:1.0:1788620282.238921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620282.238959:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.239079:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045015040 00000100:00100000:2.0:1788620282.239090:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045015040 00000100:00100000:2.0:1788620282.239149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 99 00000100:00100000:2.0:1788620282.239159:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:10498:x1875504045015040:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620282.239188:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.239207:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0bdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2407 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.239325:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0be4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.239338:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.239348:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620282.239359:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788620282.239467:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0bdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2407 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.239483:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2407 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.239491:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:2.0:1788620282.239494:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788620282.239497:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3a00, rc 0) 00000100:00100000:2.0:1788620282.239563:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:10498:x1875504045015040:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 405us (657us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788620282.239570:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 99 00000100:00100000:3.0:1788620282.239681:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045015168 00000100:00100000:3.0:1788620282.239685:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045015168 00000100:00100000:3.0:1788620282.239724:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:3.0:1788620282.239730:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:2353:x1875504045015168:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620282.239739:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620282.239751:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2400 expref: 39 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.239770:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:3.0:1788620282.239773:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620282.239792:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:2353:x1875504045015168:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 62us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.239798:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:3.0:1788620282.247100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.247267:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045015296 00000100:00100000:2.0:1788620282.247277:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045015296 00000100:00100000:2.0:1788620282.247334:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:2.0:1788620282.247343:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504045015296:12345-192.168.201.11@tcp:1:lfs.0 00010000:00010000:2.0:1788620282.247389:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.247408:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.247416:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620282.247421:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788620282.247426:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.247461:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.247474:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 8 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.247488:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a069500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875504061807360:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620282.247580:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6808240c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620282.251437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620282.251518:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045015424 00000100:00100000:3.0:1788620282.251531:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045015424 00002000:00100000:3.0:1788620282.251583:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0d643727800 x1875504045015424/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:378/0 lens 504/0 e 0 to 0 dl 1788620293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620282.251595:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d643727800 with x1875504045015424 ext(0->8) 00010000:00010000:3.0:1788620282.251604:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 9 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.251618:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 9 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620282.251625:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d643727800 00000100:00100000:3.0:1788620282.251664:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:3.0:1788620282.251672:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504045015424:12345-192.168.201.11@tcp:4:lfs.0 00000100:00100000:3.0:1788620282.252403:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:2356:x1875504045015424:12345-192.168.201.11@tcp:4:lfs.0 Request processed in 728us (973us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788620282.252411:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 1 00002000:00100000:3.0:1788620282.252418:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0d643727800 x1875504045015424/t4294967302(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:378/0 lens 504/448 e 0 to 0 dl 1788620293 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620282.252427:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d643727800 with x1875504045015424 ext(0->8) 00010000:00010000:3.0:1788620282.252434:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 11 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.252446:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 11 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620282.252454:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d643727800 00000100:00100000:1.0:1788620282.254815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620282.254898:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045015552 00000100:00100000:3.0:1788620282.254907:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045015552 00010000:00010000:3.0:1788620282.254942:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 11 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620282.254984:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:3.0:1788620282.254993:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:2353:x1875504045015552:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620282.255007:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788620282.255023:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788620282.255026:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788620281 00002000:00010000:3.0:1788620282.255029:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788620281 00002000:00010000:3.0:1788620282.255031:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788620281 00010000:00010000:3.0:1788620282.255058:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 11 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.255071:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 11 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.255094:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788620282.255098:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788620282.255104:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.255114:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.255133:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620282.255178:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:2353:x1875504045015552:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 186us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.255185:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 50 00010000:00010000:2.0:1788620282.256336:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa094e1/0x24857de440bd0bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f2 expref: 10 pid: 7779 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.256357:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a069500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1875504061807360:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620282.256386:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256396:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256404:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256434:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256442:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256450:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256457:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620282.256460:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256485:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256500:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.256508:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd0bf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.256615:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504045015296:12345-192.168.201.11@tcp:1:lfs.0 Request processed in 9272us (9527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.256624:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:1.0:1788620282.259141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620282.259238:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045015808 00000100:00100000:0.0:1788620282.259338:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045015808 00000100:00100000:0.0:1788620282.259410:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 26 00000100:00100000:0.0:1788620282.259420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:10498:x1875504045015808:12345-192.168.201.11@tcp:35:lfs.0 00000004:00010000:0.0:1788620282.259492:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2407 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620282.259717:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788620282.259754:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788620282.260392:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788620282.260445:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.260459:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 42 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.260467:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.260499:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 42 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.260512:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 42 pid: 8736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620282.260526:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061807488:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620282.260611:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d647db2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620282.263133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620282.263294:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045015936 00000100:00100000:3.0:1788620282.263304:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045015936 00010000:00010000:3.0:1788620282.263340:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 43 pid: 8736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620282.263374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:3.0:1788620282.263384:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:2355:x1875504045015936:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620282.263398:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620282.263405:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 43 pid: 8736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.263430:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 43 pid: 8736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.263451:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:3.0:1788620282.263456:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.263465:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.263471:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.263488:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620282.263528:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:2355:x1875504045015936:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 146us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.263535:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 51 00010000:00010000:0.0:1788620282.263634:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0b9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23e4 expref: 42 pid: 8736 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620282.263649:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061807488:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620282.263678:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.263694:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.263701:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620282.264018:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788620282.264298:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788620282.264402:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061807616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788620282.264450:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620282.264476:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788620282.265626:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061807616 00000100:00100000:3.0:1788620282.265639:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061807616 00000100:00100000:3.0:1788620282.265705:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620282.265716:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5842:x1875504061807616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788620282.267021:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5842:x1875504061807616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1302us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.267030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620282.267477:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061807616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788620282.269002:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788620282.269228:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643726a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061807744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788620282.269412:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620282.269484:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d647db2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788620282.269536:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061807744 00000100:00100000:2.0:1788620282.269543:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061807744 00000100:00100000:2.0:1788620282.269629:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620282.269639:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875504061807744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788620282.269878:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5842:x1875504061807744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 231us (456us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788620282.269885:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620282.269953:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643726a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061807744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788620282.270008:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788620282.270058:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620282.270084:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620282.270092:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620282.270099:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620282.270104:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620282.270112:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620282.270129:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:1.0:1788620282.270132:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788620282.270137:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620282.270143:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0bf9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788620282.270351:0:5842:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788620282.270448:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788620282.270460:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332309209598ns, next at 333309207616ns, rc = 0 00000001:00080000:1.0:1788620282.270467:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788620282.270498:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c200) 00010000:00010000:1.0:1788620282.270501:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788620282.270507:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0be4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2407 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620282.270621:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:10498:x1875504045015808:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 11202us (11491us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788620282.270630:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 26 00000020:00080000:1.0:1788620282.270634:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788620282.275485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.275563:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045016064 00000100:00100000:2.0:1788620282.275573:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045016064 00000100:00100000:2.0:1788620282.275650:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 100 00000100:00100000:2.0:1788620282.275666:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:10498:x1875504045016064:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620282.275692:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.275723:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b240e expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.275791:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b240e expref: 46 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.275805:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0c00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b240e expref: 46 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.275824:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620282.275828:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620282.275831:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3000, rc 0) 00000100:00100000:2.0:1788620282.275897:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:10498:x1875504045016064:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 233us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.275904:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 100 00000100:00100000:0.0:1788620282.278931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.279003:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045016320 00000100:00100000:2.0:1788620282.279012:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045016320 00000100:00100000:2.0:1788620282.279063:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:2.0:1788620282.279073:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:10498:x1875504045016320:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620282.279310:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10498:x1875504045016320:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 238us (388us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788620282.279317:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:1.0:1788620282.367507:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.367608:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045016448 00000100:00100000:2.0:1788620282.367617:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045016448 00000100:00100000:2.0:1788620282.367675:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 101 00000100:00100000:2.0:1788620282.367684:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10508:x1875504045016448:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:2.0:1788620282.367750:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367792:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367803:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367819:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367827:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367833:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367932:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367939:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367946:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620282.367983:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.367995:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368000:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368016:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368023:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620282.368027:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368035:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368047:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620282.368050:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620282.368055:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368062:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0c07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368075:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368082:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368088:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368093:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620282.368095:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368110:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368117:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d647f7c300) 00010000:00010000:2.0:1788620282.368119:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620282.368122:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368128:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368141:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368147:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368153:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368158:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620282.368161:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368166:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368172:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620282.368174:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620282.368177:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.368190:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.368302:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10508:x1875504045016448:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 618us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.368310:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 101 00000100:00100000:3.0:1788620282.413645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620282.413790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045016704 00000100:00100000:0.0:1788620282.413800:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045016704 00000100:00100000:0.0:1788620282.413876:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 102 00000100:00100000:0.0:1788620282.413886:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:10511:x1875504045016704:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620282.413906:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620282.413924:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2415 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.413993:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414006:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414017:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414057:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414065:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414072:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414183:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414192:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414199:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620282.414444:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788620282.414531:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414539:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414546:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414552:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620282.414557:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414574:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414586:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620282.414589:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620282.414593:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414600:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414613:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414619:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414625:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414630:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620282.414633:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414639:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414645:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d642f43000) 00010000:00010000:0.0:1788620282.414647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620282.414660:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414674:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414710:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2415 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414722:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2415 expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.414730:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620282.414732:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620282.414735:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519c00, rc 0) 00000100:00100000:0.0:1788620282.415052:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:10511:x1875504045016704:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1166us (1413us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788620282.415060:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 102 00000100:00100000:1.0:1788620282.420328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.420423:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045016832 00000100:00100000:2.0:1788620282.420432:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045016832 00000100:00100000:2.0:1788620282.420510:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 103 00000100:00100000:2.0:1788620282.420520:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:10511:x1875504045016832:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:2.0:1788620282.420586:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420601:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420612:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420640:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420647:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420664:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420671:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620282.420675:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420693:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420705:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620282.420708:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620282.420713:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.420720:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.420790:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:10511:x1875504045016832:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 271us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.420798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 103 00000100:00100000:1.0:1788620282.425809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.425889:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045017088 00000100:00100000:2.0:1788620282.425899:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045017088 00000100:00100000:2.0:1788620282.425954:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00100000:2.0:1788620282.425965:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:10511:x1875504045017088:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620282.426230:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:10511:x1875504045017088:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 266us (429us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788620282.426237:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00100000:3.0:1788620282.529638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.529743:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045017344 00000100:00100000:2.0:1788620282.529754:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045017344 00000100:00100000:2.0:1788620282.529833:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 104 00000100:00100000:2.0:1788620282.529844:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:10521:x1875504045017344:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:2.0:1788620282.529889:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.529892:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788620282.529931:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23f9 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.529953:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:2.0:1788620282.529958:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620282.529975:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b241c expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.530088:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.530108:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.530118:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620282.530132:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788620282.530835:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b241c expref: 52 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.530852:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b241c expref: 51 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.531124:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620282.531133:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620282.531146:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2c00, rc 0) 00000100:00100000:2.0:1788620282.531469:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:10521:x1875504045017344:12345-192.168.201.11@tcp:101:bash.0 Request processed in 1626us (1840us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788620282.531478:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 104 00000100:00100000:0.0:1788620282.535684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.535932:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045017600 00000100:00100000:2.0:1788620282.535942:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045017600 00000100:00100000:2.0:1788620282.536000:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 105 00000100:00100000:2.0:1788620282.536011:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:10521:x1875504045017600:12345-192.168.201.11@tcp:36:bash.0 00010000:00010000:2.0:1788620282.536144:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788620282.536180:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b241c expref: 51 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.536201:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2415 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.536211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620282.536216:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620282.536549:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.536564:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.536575:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620282.536617:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788620282.536639:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8a1904d reply state 000000006559585c transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.536647:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620282.536730:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10521:x1875504045017600:12345-192.168.201.11@tcp:36:bash.0 Request processed in 721us (1054us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788620282.536738:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 105 00000020:00080000:2.0:1788620282.536756:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788620282.542505:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00010000:00010000:3.0:1788620282.542625:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.542655:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.542663:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.542669:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620282.542674:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.542681:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.542698:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620282.542702:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620282.542707:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.542714:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0c5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620282.542897:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045017728 00000100:00100000:0.0:1788620282.542911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045017728 00000100:00100000:0.0:1788620282.543000:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 106 00000100:00100000:0.0:1788620282.543012:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:10521:x1875504045017728:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620282.543043:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620282.543057:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2423 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.543145:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.543160:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.543168:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620282.543190:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788620282.543193:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620282.543210:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.543236:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.543288:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.543295:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620282.543297:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620282.543300:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518800, rc 0) 00000100:00100000:0.0:1788620282.543360:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10521:x1875504045017728:12345-192.168.201.11@tcp:101:bash.0 Request processed in 349us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620282.543367:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 106 00000100:00100000:3.0:1788620282.545988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.546304:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045017984 00000100:00100000:2.0:1788620282.546316:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045017984 00000100:00100000:2.0:1788620282.546379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 29 00000100:00100000:2.0:1788620282.546390:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:10521:x1875504045017984:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:2.0:1788620282.546633:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10521:x1875504045017984:12345-192.168.201.11@tcp:35:bash.0 Request processed in 246us (656us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788620282.546639:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 29 00000100:00100000:1.0:1788620282.652078:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620282.652315:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045018112 00000100:00100000:3.0:1788620282.652328:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045018112 00000100:00100000:3.0:1788620282.652402:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 107 00000100:00100000:3.0:1788620282.652414:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:10527:x1875504045018112:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620282.652458:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620282.652485:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b242a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.652615:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0c77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.652635:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.652663:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620282.652755:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788620282.652759:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620282.652786:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.653055:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b242a expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.653081:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0c77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b242a expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.653090:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:3.0:1788620282.653093:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620282.653098:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643200, rc 0) 00000100:00100000:3.0:1788620282.653173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10527:x1875504045018112:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 760us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.653181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 107 00000100:00100000:3.0:1788620282.658700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620282.660001:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045018240 00000100:00100000:0.0:1788620282.660013:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045018240 00000100:00100000:0.0:1788620282.660081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 108 00000100:00100000:0.0:1788620282.660092:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10527:x1875504045018240:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620282.660138:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620282.660175:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2431 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660238:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660273:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660286:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660329:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660338:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660345:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660448:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660457:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660464:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620282.660498:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788620282.660503:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620282.660520:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660539:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660548:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660555:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660562:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660568:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620282.660573:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660581:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660594:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620282.660597:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620282.660602:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660609:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660622:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660628:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660642:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660646:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620282.660649:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660655:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660663:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d642f43000) 00010000:00010000:0.0:1788620282.660665:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620282.660667:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660673:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0c8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660703:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0c7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660716:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.660723:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620282.660724:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620282.660727:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519c00, rc 0) 00000100:00100000:0.0:1788620282.660803:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10527:x1875504045018240:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 712us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620282.662264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 108 00000100:00100000:1.0:1788620282.669693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620282.669781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.669885:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045018624 00000100:00100000:2.0:1788620282.669896:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045018624 00000100:00100000:2.0:1788620282.669962:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 109 00000100:00100000:2.0:1788620282.669971:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10527:x1875504045018624:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620282.669992:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620282.670013:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2438 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.670112:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.670127:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.670136:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.670144:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.670177:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.670216:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.670230:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a069500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061807872:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620282.670361:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.670371:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.670380:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061808000:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620282.670405:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680824240 going to sleep for 11 seconds 00000100:00100000:3.0:1788620282.670849:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045018368 00000100:00100000:3.0:1788620282.670973:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045018368 00010000:00010000:3.0:1788620282.671001:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 57 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620282.671032:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:3.0:1788620282.671046:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:2355:x1875504045018368:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620282.671057:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620282.671063:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 57 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.671075:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 57 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.671093:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620282.671098:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.671106:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.671112:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620282.671148:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:2355:x1875504045018368:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 108us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.671155:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 52 00010000:00010000:2.0:1788620282.676435:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.11@tcp) returned -22 from blocking AST (req@00000000b33eb727 x1875504061807872) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676467:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2431 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.676488:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a069500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061807872:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620282.676505:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a06b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061808000:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620282.676543:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620282.676550:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676582:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676592:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620282.676606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620282.676637:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045018752 00000100:00100000:2.0:1788620282.676645:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045018752 00010000:00010000:2.0:1788620282.676683:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620282.676722:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:2.0:1788620282.676733:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:2355:x1875504045018752:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620282.676750:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620282.676756:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676768:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676789:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0c69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2423 expref: 56 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676799:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620282.676802:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676810:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676824:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620282.676856:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620282.676942:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:2355:x1875504045018752:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 209us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620282.676949:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 53 00010000:00010000:0.0:1788620282.677050:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.677058:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620282.677081:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788620282.677287:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.677305:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.677315:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620282.677318:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788620282.677321:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2200, rc 0) 00000100:00100000:0.0:1788620282.677351:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10527:x1875504045018624:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 7382us (7570us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788620282.677358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 109 00000100:00100000:1.0:1788620282.687352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620282.687742:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045019008 00000100:00100000:3.0:1788620282.687764:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045019008 00000100:00100000:3.0:1788620282.687941:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:3.0:1788620282.687952:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10527:x1875504045019008:12345-192.168.201.11@tcp:103:lfs.0 00010000:00010000:3.0:1788620282.687985:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620282.688010:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b240e expref: 55 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620282.688026:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620282.688107:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620282.688206:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10527:x1875504045019008:12345-192.168.201.11@tcp:103:lfs.0 Request processed in 255us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620282.688214:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:2.0:1788620282.698990:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620282.699090:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045019136 00000100:00100000:0.0:1788620282.699100:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045019136 00000100:00100000:0.0:1788620282.699163:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 110 00000100:00100000:0.0:1788620282.699173:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10527:x1875504045019136:12345-192.168.201.11@tcp:58:lfs.0 00010000:00010000:0.0:1788620282.699352:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.699370:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.699398:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620282.699594:0:8736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788620282.699680:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10527:x1875504045019136:12345-192.168.201.11@tcp:58:lfs.0 Request processed in 508us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620282.699688:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 110 00000100:00100000:1.0:1788620282.702369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620282.705481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045019264 00000100:00100000:0.0:1788620282.705495:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045019264 00000100:00100000:0.0:1788620282.705570:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 111 00000100:00100000:0.0:1788620282.705579:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:10527:x1875504045019264:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620282.705598:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620282.705615:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b243f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.705669:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.705680:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.705699:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.705711:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.705724:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620282.705739:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620282.705743:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620282.705751:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518400, rc 0) 00000100:00100000:0.0:1788620282.705816:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10527:x1875504045019264:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 238us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620282.705823:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 111 00010000:00010000:1.0:1788620283.178168:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788620283.432986:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620283.432996:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620283.433045:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788620283.433052:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788620283.433497:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b83800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061808128:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788620283.433611:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788620283.439991:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b83800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061808128:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788620283.439991:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.440330:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045019392 00000100:00100000:0.0:1788620283.440339:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045019392 00000100:00100000:0.0:1788620283.440410:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 112 00000100:00100000:0.0:1788620283.440421:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045019392:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788620283.440461:0:8736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788620283.440579:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045019392:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 159us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.440586:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 112 00000100:00100000:1.0:1788620283.453132:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.453234:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045019520 00000100:00100000:0.0:1788620283.453244:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045019520 00000100:00100000:0.0:1788620283.453328:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 113 00000100:00100000:0.0:1788620283.453339:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10528:x1875504045019520:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.453411:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453428:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453440:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453528:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453535:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453542:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453576:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453584:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453590:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620283.453629:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788620283.453633:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620283.453646:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453656:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453664:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453670:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453686:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.453690:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453698:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453710:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:0.0:1788620283.453713:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620283.453718:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453723:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0cbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453737:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453743:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453749:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453755:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.453757:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453764:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453781:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffffa0d642f43000) 00010000:00010000:0.0:1788620283.453784:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620283.453787:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453793:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cc4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453807:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453813:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453818:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453823:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.453825:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453831:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453837:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620283.453840:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620283.453842:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.453856:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0ccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.453946:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10528:x1875504045019520:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 Request processed in 608us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.453955:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 113 00000100:00100000:2.0:1788620283.466540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.466757:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045019776 00000100:00100000:0.0:1788620283.466768:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045019776 00000100:00100000:0.0:1788620283.466820:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 114 00000100:00100000:0.0:1788620283.466843:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:10528:x1875504045019776:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.466871:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620283.466889:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0cd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2446 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467017:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467034:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467046:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620283.467056:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788620283.467145:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467153:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467159:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467183:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.467187:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467194:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467207:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620283.467210:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788620283.467215:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467221:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467307:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0cd2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2446 expref: 57 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467319:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:0.0:1788620283.467321:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788620283.467325:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd0cd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2446 expref: 57 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.467335:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518800, rc 0) 00000100:00100000:0.0:1788620283.467399:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045019776:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 570us (865us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788620283.467407:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 114 00000100:00100000:1.0:1788620283.469703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.469770:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045019904 00000100:00100000:0.0:1788620283.469789:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045019904 00000100:00100000:0.0:1788620283.469863:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00100000:0.0:1788620283.469874:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045019904:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788620283.469910:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788620283.470420:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045019904:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 545us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.470429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00100000:3.0:1788620283.473421:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.476798:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045020160 00000100:00100000:0.0:1788620283.476814:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045020160 00000100:00100000:0.0:1788620283.476903:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 116 00000100:00100000:0.0:1788620283.476925:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045020160:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.476953:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620283.476956:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788620283.476984:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0c77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b242a expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.477014:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620283.477019:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620283.477034:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0ce7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b244d expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620283.477881:0:8736:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788620283.478495:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.478511:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.478543:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.481684:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd0ce7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b244d expref: 58 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.481709:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b244d expref: 57 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.481719:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d642f43000) 00010000:00010000:0.0:1788620283.481722:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620283.481726:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519c00, rc 0) 00000100:00100000:0.0:1788620283.481857:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10528:x1875504045020160:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 4934us (8436us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788620283.481867:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 116 00000100:00100000:2.0:1788620283.504172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.504279:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045020416 00000100:00100000:0.0:1788620283.504288:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045020416 00000100:00100000:0.0:1788620283.504352:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 117 00000100:00100000:0.0:1788620283.504360:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10528:x1875504045020416:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.504411:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620283.504435:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd0cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b244d expref: 57 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504449:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d642f43000) 00010000:00010000:0.0:1788620283.504459:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620283.504478:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504501:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504507:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504560:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504565:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504569:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504632:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504647:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504652:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504656:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.504659:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504663:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504668:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620283.504674:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620283.504677:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504681:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd0cfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504687:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504694:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504698:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504701:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.504702:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504705:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504709:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x73342061 (ffffa0d642f43200) 00010000:00010000:0.0:1788620283.504711:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620283.504712:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.504715:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x73342061 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.504786:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045020416:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 426us (623us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620283.504797:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 117 00000100:00100000:0.0:1788620283.508275:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.508430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045020544 00000100:00100000:3.0:1788620283.508439:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045020544 00000100:00100000:3.0:1788620283.508485:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 118 00000100:00100000:3.0:1788620283.508492:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:10528:x1875504045020544:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620283.508507:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620283.508523:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2454 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.508550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.508571:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.508579:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.509581:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.509607:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.509617:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620283.509620:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788620283.509624:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642e00, rc 0) 00000100:00100000:3.0:1788620283.510147:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10528:x1875504045020544:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 1651us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.510157:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 118 00000100:00100000:1.0:1788620283.521662:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.521778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045020800 00000100:00100000:0.0:1788620283.521789:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045020800 00000100:00100000:0.0:1788620283.521873:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:0.0:1788620283.521891:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:10528:x1875504045020800:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.521996:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.522013:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.522041:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620283.522439:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788620283.522456:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333561205281ns, next at 334561202590ns, rc = 0 00000004:00010000:0.0:1788620283.522555:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e1cb18d reply state 0000000031c9d688 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.522565:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620283.522677:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:10528:x1875504045020800:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 788us (1023us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788620283.522692:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:2.0:1788620283.533946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.534029:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045020928 00000100:00100000:0.0:1788620283.534040:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045020928 00000100:00100000:0.0:1788620283.534106:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 120 00000100:00100000:0.0:1788620283.534122:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:10528:x1875504045020928:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.534160:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620283.534181:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b245b expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.534289:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 60 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.534305:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 60 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.534325:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:0.0:1788620283.534329:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620283.534333:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031800, rc 0) 00000100:00100000:0.0:1788620283.534387:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:10528:x1875504045020928:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 273us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.534394:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 120 00010000:00010000:3.0:1788620283.535538:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.535554:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.535561:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.535568:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620283.535572:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.535596:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.535611:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620283.535614:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788620283.535619:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.535625:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620283.539491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.539670:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045021056 00000100:00100000:0.0:1788620283.539683:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045021056 00000100:00080000:3.0:1788620283.539824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620283.539916:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:0.0:1788620283.539927:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504045021056:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788620283.540232:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2355:x1875504045021056:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 307us (751us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788620283.540239:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:2.0:1788620283.543942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.544376:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045021312 00000100:00100000:0.0:1788620283.544387:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045021312 00000100:00100000:0.0:1788620283.544459:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 30 00000100:00100000:0.0:1788620283.544470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:10528:x1875504045021312:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788620283.544745:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:10528:x1875504045021312:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 276us (811us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788620283.544753:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 30 00000100:00100000:1.0:1788620283.547912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.548006:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045021568 00000100:00100000:0.0:1788620283.548016:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045021568 00000100:00100000:0.0:1788620283.548086:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 121 00000100:00100000:0.0:1788620283.548096:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:10528:x1875504045021568:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788620283.548412:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:10528:x1875504045021568:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 315us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.548420:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 121 00000100:00100000:1.0:1788620283.551870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.551962:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045021696 00000100:00100000:0.0:1788620283.551971:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045021696 00000100:00100000:0.0:1788620283.552160:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 122 00000100:00100000:0.0:1788620283.552172:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:10528:x1875504045021696:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.552191:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620283.552212:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2462 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.552318:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.552332:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.552344:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620283.552396:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620283.552415:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.552441:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2462 expref: 62 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.552458:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2462 expref: 61 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.552467:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:0.0:1788620283.552470:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788620283.552474:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030c00, rc 0) 00000100:00100000:0.0:1788620283.552528:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:10528:x1875504045021696:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 358us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.552535:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 122 00000100:00100000:2.0:1788620283.555125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.555279:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045021824 00000100:00100000:3.0:1788620283.555290:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045021824 00000100:00100000:3.0:1788620283.555346:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:3.0:1788620283.555356:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504045021824:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620283.555376:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620283.555399:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2469 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620283.555426:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2dfb, blocks: 0x1 00010000:00010000:3.0:1788620283.555446:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1788620283.555451:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620283.555461:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 10 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.555478:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 10 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.555513:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643a00, rc 0) 00000100:00100000:3.0:1788620283.555583:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:2356:x1875504045021824:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 228us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.555591:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:2.0:1788620283.562936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.563029:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045022080 00000100:00100000:3.0:1788620283.563041:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045022080 00000100:00100000:3.0:1788620283.563096:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 123 00000100:00100000:3.0:1788620283.563107:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:10528:x1875504045022080:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788620283.563381:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:10528:x1875504045022080:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 275us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.563390:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 123 00000100:00100000:0.0:1788620283.567091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620283.567288:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045022208 00000100:00100000:2.0:1788620283.567298:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045022208 00000100:00100000:2.0:1788620283.567352:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:2.0:1788620283.567362:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:10528:x1875504045022208:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620283.567379:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620283.567398:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2470 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.567431:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.567440:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620283.567458:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620283.567464:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 11 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.567501:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.567515:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 11 pid: 6686 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620283.567528:0:7779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1875504061808256:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620283.567683:0:7779:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680824240 going to sleep for 11 seconds 00000100:00100000:2.0:1788620283.575420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.575498:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045022336 00000100:00100000:0.0:1788620283.575506:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045022336 00010000:00010000:0.0:1788620283.575539:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 12 pid: 6686 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.575574:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 54 00000100:00100000:0.0:1788620283.575580:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:2356:x1875504045022336:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620283.575591:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620283.575608:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 12 pid: 6686 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.575637:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 12 pid: 6686 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.575658:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620283.575662:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620283.575668:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 12 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.575674:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 12 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.575704:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 12 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.575713:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875504061808384:192.168.201.11@tcp:105: 00000100:00100000:0.0:1788620283.575784:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c300 going to sleep for 11 seconds 00010000:00010000:3.0:1788620283.576425:0:7779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0d34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2469 expref: 12 pid: 6686 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620283.576444:0:7779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1875504061808256:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620283.576477:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 11 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.576489:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2e00, rc 0) 00000100:00100000:3.0:1788620283.576534:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:10528:x1875504045022208:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 9173us (9453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.576730:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:0.0:1788620283.580542:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875504061808384:192.168.201.11@tcp:105: 00010000:00010000:0.0:1788620283.580571:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620283.580671:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:2356:x1875504045022336:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 5088us (5257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.580682:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 54 00000100:00100000:2.0:1788620283.589065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.589199:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045022464 00000100:00100000:3.0:1788620283.589221:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045022464 00002000:00100000:3.0:1788620283.589309:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0d67f815880 x1875504045022464/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:379/0 lens 504/0 e 0 to 0 dl 1788620294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620283.589322:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d67f815880 with x1875504045022464 ext(0->12) 00002000:00010000:3.0:1788620283.589328:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d67f815880 00000100:00100000:3.0:1788620283.589364:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:3.0:1788620283.589375:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:2356:x1875504045022464:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788620283.589799:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:2356:x1875504045022464:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 Request processed in 425us (744us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788620283.589809:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00002000:00100000:3.0:1788620283.589817:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0d67f815880 x1875504045022464/t4294967308(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:379/0 lens 504/448 e 0 to 0 dl 1788620294 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620283.589825:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d67f815880 with x1875504045022464 ext(0->12) 00002000:00010000:3.0:1788620283.589828:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d67f815880 00000100:00100000:2.0:1788620283.602199:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620283.602533:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045022592 00000100:00100000:1.0:1788620283.602543:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045022592 00000100:00100000:1.0:1788620283.602606:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 124 00000100:00100000:1.0:1788620283.602853:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:10528:x1875504045022592:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788620283.695215:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788620283.695245:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788620283.695619:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620283.695653:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061808512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788620283.695723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620283.695758:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061808512 00000100:00100000:1.0:1788620283.695772:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061808512 00000100:00100000:0.0:1788620283.695777:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061808640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788620283.695800:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620283.695838:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061808640 00000100:00100000:1.0:1788620283.695841:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061808640 00000100:00100000:1.0:1788620283.695881:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788620283.695910:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875504061808512:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788620283.695915:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788620283.695923:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875504061808640:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:1.0:1788620283.695935:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788620283.695955:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.695984:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.695994:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788620283.695998:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620283.696007:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.696065:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.696079:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 11 pid: 6687 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620283.696092:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061808768:192.168.201.11@tcp:104: 00002000:00010000:0.0:1788620283.696123:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788620283.696128:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788620283 00002000:00010000:0.0:1788620283.696130:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788620283.696132:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788620283 -> 1788620283 00002000:00010000:0.0:1788620283.696135:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788620283.696164:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620283.696170:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1875504061808640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (369us total) trans 4294967309 rc 0/0 00000100:00080000:1.0:1788620283.696178:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620283.696178:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788620283.696219:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d680b51500/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788620283.696234:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061808640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1788620283.696539:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788620283.696556:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d6436cd3c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788620283.696560:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d666dd3500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d6436cd6c0 00000020:00080000:0.0:1788620283.696563:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d666dd3800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d675b10c00 00000004:00080000:0.0:1788620283.696611:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788620283.696640:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d681a1bb40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788620283.696644:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d680855100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d681a1bcc0 00000020:00080000:0.0:1788620283.696647:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d680855300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d675c49000 00000020:00080000:0.0:1788620283.696652:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788620283.696714:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788620283.696971:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788620283.697434:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:10528:x1875504045022592:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 Request processed in 94801us (95242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.697444:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 124 00000100:00100000:0.0:1788620283.700107:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061808896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788620283.700221:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620283.700708:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061808896 00000100:00100000:1.0:1788620283.700717:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061808896 00000100:00100000:1.0:1788620283.700793:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788620283.700811:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1875504061808896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788620283.700855:0:7779:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788620283.700895:0:7779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c2df9, atime: 0x6a9c2df9, ctime: 0x6a9c2df9, blocks: 0x1 00010000:00010000:1.0:1788620283.700904:0:7779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.700926:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1788620283.700930:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620283.700942:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.700963:0:7779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.700978:0:7779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.700986:0:7779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.701016:0:7779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1788620283.701720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788620283.702362:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620283.702373:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.702385:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620283.702390:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.702401:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.702438:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.702445:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0d49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.702470:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620283.702472:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620283.702474:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620283.702569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.703286:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061808768:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620283.703310:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620283.703799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000004:00080000:2.0:1788620283.703853:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d666e28700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788620283.703861:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061808896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788620283.704121:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045022848 00000100:00100000:0.0:1788620283.704135:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045022848 00010000:00010000:0.0:1788620283.704189:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 12 pid: 6687 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.704228:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:0.0:1788620283.704239:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:2353:x1875504045022848:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620283.704279:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620283.704286:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 12 pid: 6687 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.704299:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 12 pid: 6687 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.704321:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd0b04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23cf expref: 12 pid: 6687 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.704335:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620283.704339:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620283.704345:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.704356:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.704402:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620283.704455:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:2353:x1875504045022848:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 217us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.704463:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:0.0:1788620283.704610:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788620283.704618:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788620283.704740:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788620283.704895:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3309:x1875504061808896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2218us (2800us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788620283.704955:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788620283.704977:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045022720 00000100:00100000:1.0:1788620283.704997:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045022720 00010000:00010000:2.0:1788620283.705146:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.705157:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.705167:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.705175:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.705214:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788620283.705946:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1875504061808512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10055us (10220us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788620283.706132:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:1.0:1788620283.706147:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d648530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:2355:x1875504045022720:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788620283.706815:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d68084f100/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788620283.706822:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68084f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061808512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788620283.707509:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788620283.707538:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620283.707547:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.707558:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620283.707563:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.707574:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.707594:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.707602:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad2692ce/0x24857de440bd0d42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.707633:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620283.707635:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620283.707636:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788620283.741209:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788620283.741224:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788620283.741409:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788620283.741420:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788620283.741597:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d648530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045022720:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 Request processed in 35448us (37794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.741619:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:2.0:1788620283.745515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.745661:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045023104 00000100:00100000:3.0:1788620283.745672:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045023104 00000100:00100000:3.0:1788620283.745737:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 125 00000100:00100000:3.0:1788620283.745749:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:10528:x1875504045023104:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788620283.745804:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620283.745835:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2462 expref: 15 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.745867:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620283.745873:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620283.745905:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.745919:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.745928:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788620283.746200:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e69aa65a reply state 00000000b5d51a8a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620283.746211:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620283.746699:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:10528:x1875504045023104:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 951us (1194us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788620283.746707:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 125 00010000:00010000:3.0:1788620283.749446:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.749476:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.749483:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.749488:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620283.749493:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.749500:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.749525:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:3.0:1788620283.749528:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620283.749532:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.749538:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620283.758086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.759172:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045023232 00000100:00100000:0.0:1788620283.759186:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045023232 00000100:00100000:0.0:1788620283.759290:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:0.0:1788620283.759301:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045023232:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788620283.759655:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788620283.759659:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788620283 -> 1788620282 00002000:00010000:0.0:1788620283.759662:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788620281 00002000:00010000:0.0:1788620283.759664:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788620283 -> 1788620282 00002000:00010000:0.0:1788620283.759667:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788620283.759751:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045023232:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 452us (1674us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788620283.759760:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:2.0:1788620283.767371:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.767704:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045023488 00000100:00100000:0.0:1788620283.767715:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045023488 00000100:00100000:0.0:1788620283.767787:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 126 00000100:00100000:0.0:1788620283.767799:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:10528:x1875504045023488:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.767898:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.767917:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.767926:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.767961:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.767976:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 15 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.767989:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061809024:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620283.768085:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620283.772913:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061809024:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620283.772943:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620283.773064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.773201:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045023616 00000100:00100000:0.0:1788620283.773209:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045023616 00010000:00010000:0.0:1788620283.773281:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 16 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.773322:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 56 00000100:00100000:0.0:1788620283.773332:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:2355:x1875504045023616:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620283.773360:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620283.773368:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 16 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.773380:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 16 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.773405:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2454 expref: 16 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.773422:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:0.0:1788620283.773427:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.773436:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.773444:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.773464:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620283.773519:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:2355:x1875504045023616:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 188us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.773527:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 56 00010000:00010000:1.0:1788620283.773728:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773736:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773766:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773773:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773780:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773787:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620283.773791:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773800:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773810:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:1.0:1788620283.773814:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788620283.773825:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.773832:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0d57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620283.773906:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:10528:x1875504045023488:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 Request processed in 6110us (6548us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788620283.773915:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 126 00000100:00100000:2.0:1788620283.788819:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620283.788910:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045023744 00000100:00100000:1.0:1788620283.788920:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045023744 00000100:00100000:1.0:1788620283.788980:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:1.0:1788620283.788991:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045023744:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788620283.789049:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.789072:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.789082:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620283.789086:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620283.789091:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.789127:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.789141:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 7 pid: 7779 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620283.789169:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875504061809152:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620283.789276:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620283.804517:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875504061809152:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620283.804549:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620283.817596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.817728:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045023872 00000100:00100000:0.0:1788620283.817740:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045023872 00010000:00010000:0.0:1788620283.817782:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 8 pid: 7779 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.817913:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 57 00000100:00100000:0.0:1788620283.817924:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504045023872:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620283.817941:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620283.817964:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 8 pid: 7779 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.817980:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 8 pid: 7779 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.818003:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000229f2974/0x24857de440bd0d3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2470 expref: 8 pid: 7779 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.818033:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620283.818038:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620283.818044:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.818055:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.818089:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620283.818155:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045023872:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 233us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.818164:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 57 00010000:00010000:1.0:1788620283.818326:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818337:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818366:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818376:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818384:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818393:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620283.818399:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818423:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818437:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.818445:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd0d5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620283.818503:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045023744:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 Request processed in 29513us (29695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620283.818513:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:3.0:1788620283.823916:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620283.829284:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045024128 00000100:00100000:0.0:1788620283.829303:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045024128 00000100:00100000:0.0:1788620283.829390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 127 00000100:00100000:0.0:1788620283.829402:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:10528:x1875504045024128:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788620283.829479:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.829497:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.829510:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.830093:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.830107:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 15 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.830115:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.830151:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 15 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.830165:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 15 pid: 8736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.830454:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061809280:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620283.830543:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788620283.835388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620283.835440:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045024256 00000100:00100000:1.0:1788620283.835450:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045024256 00010000:00010000:1.0:1788620283.835493:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 16 pid: 8736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620283.835532:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00100000:1.0:1788620283.835545:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:2355:x1875504045024256:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620283.835561:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620283.835569:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 16 pid: 8736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.835583:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 16 pid: 8736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.835626:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:1.0:1788620283.835645:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.835654:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.835661:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.835682:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620283.835739:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+16:2355:x1875504045024256:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 197us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620283.835747:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 58 00010000:00010000:0.0:1788620283.838169:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0d1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b245b expref: 15 pid: 8736 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.838315:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061809280:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620283.838409:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.838418:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.838423:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620283.838614:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788620283.840916:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788620283.840975:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788620283.841091:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875504061809408:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788620283.841188:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620283.841227:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620283.841389:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061809408 00000100:00100000:3.0:1788620283.841398:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061809408 00000100:00100000:3.0:1788620283.841458:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620283.841468:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875504061809408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788620283.841551:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875504061809408:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.841558:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620283.846440:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788620283.846454:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1788620283.846478:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d680b51500, transno 4294967309 00000004:00080000:0.0:1788620283.846494:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d68084f100, transno 4294967310 00000100:00100000:0.0:1788620283.846503:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875504061809408:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788620283.847020:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788620283.847105:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875504061809536:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788620283.847174:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620283.847206:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620283.847329:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061809536 00000100:00100000:0.0:1788620283.847343:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061809536 00000100:00100000:0.0:1788620283.847381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620283.847390:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875504061809536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788620283.847577:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875504061809536:12345-0@lo:1000:mdt00_000.0 Request processed in 188us (403us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788620283.847584:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620283.847616:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643724000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875504061809536:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788620283.847647:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847657:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847665:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847671:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.847675:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847682:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847697:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d65309ea00) 00010000:00010000:0.0:1788620283.847700:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620283.847704:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847710:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd0d6c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847754:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847760:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847766:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847770:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.847774:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847779:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847788:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620283.847790:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620283.847797:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847807:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847816:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.847840:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.847881:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643727480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061809664:192.168.201.11@tcp:105: 00000100:00100000:0.0:1788620283.847942:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620283.853090:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643727480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061809664:192.168.201.11@tcp:105: 00000100:00100000:2.0:1788620283.853118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00010000:00010000:3.0:1788620283.853123:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853135:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd0caf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853172:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853185:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853196:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853206:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853212:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853218:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853224:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620283.853228:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853235:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853245:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620283.853299:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620283.853304:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853310:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d73 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853323:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853329:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853904:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853911:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620283.853915:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853920:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853930:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620283.853932:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788620283.853935:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.853941:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620283.854178:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10528:x1875504045024128:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 24778us (30272us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788620283.854188:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 127 00000020:00080000:2.0:1788620283.854195:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788620283.854528:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620283.854533:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620283.855529:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788620283.855539:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788620283.855828:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045024384 00000100:00100000:0.0:1788620283.855838:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045024384 00000100:00100000:0.0:1788620283.855901:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:0.0:1788620283.855913:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10527:x1875504045024384:12345-192.168.201.11@tcp:49:lfs.0 00000100:00100000:0.0:1788620283.856020:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10527:x1875504045024384:12345-192.168.201.11@tcp:49:lfs.0 Request processed in 110us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.856028:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:2.0:1788620283.866042:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620283.866152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.866492:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045024640 00000100:00100000:3.0:1788620283.866505:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045024640 00000100:00100000:3.0:1788620283.866573:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 128 00000100:00100000:3.0:1788620283.866584:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10527:x1875504045024640:12345-192.168.201.11@tcp:58:lfs.0 00000040:00080000:3.0:1788620283.866987:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788620283.867089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10527:x1875504045024640:12345-192.168.201.11@tcp:58:lfs.0 Request processed in 505us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620283.867097:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 128 00000100:00100000:1.0:1788620283.867693:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045024896 00000100:00100000:1.0:1788620283.867701:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045024896 00000100:00100000:1.0:1788620283.867733:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:1.0:1788620283.867741:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:10528:x1875504045024896:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788620283.868958:0:5842:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788620283.869820:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788620283.873420:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.873445:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.873458:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.873466:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.873473:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.873479:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.873519:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788620283.873646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:10528:x1875504045024896:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 5895us (7483us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788620283.873656:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 32 00000020:00080000:2.0:1788620283.873662:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788620283.875971:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620283.875984:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.875996:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620283.876001:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.876037:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.876064:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0d647f7c300) 00010000:00010000:1.0:1788620283.876067:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788620283.876073:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.876080:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0d7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620283.876109:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620283.876111:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620283.876113:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620283.928374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620283.928796:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045025024 00000100:00100000:3.0:1788620283.928806:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045025024 00000100:00100000:3.0:1788620283.928880:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 129 00000100:00100000:3.0:1788620283.928891:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:10530:x1875504045025024:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620283.928917:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620283.928936:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2477 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.928998:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929036:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929063:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929091:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929098:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929437:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929448:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929457:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929490:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620283.929503:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 21 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620283.929517:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061809792:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620283.929606:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620283.938556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620283.938660:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045025280 00000100:00100000:1.0:1788620283.938670:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045025280 00000100:00100000:1.0:1788620283.938733:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:1.0:1788620283.938743:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:5591:x1875504045025280:12345-192.168.201.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788620283.939000:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:5591:x1875504045025280:12345-192.168.201.11@tcp:35:ldlm_bl.0 Request processed in 257us (455us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788620283.939007:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:3.0:1788620283.940244:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061809792:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620283.940309:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620283.945616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620283.945733:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045025408 00000100:00100000:2.0:1788620283.945744:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045025408 00010000:00010000:2.0:1788620283.945785:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 23 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620283.945827:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:2.0:1788620283.945836:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:2355:x1875504045025408:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620283.945868:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620283.945876:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 23 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.945889:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 23 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.945913:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ca1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2438 expref: 23 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.945929:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620283.945934:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.945960:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.945968:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620283.946007:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620283.946081:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:2355:x1875504045025408:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 245us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620283.946088:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 59 00010000:00010000:0.0:1788620283.947208:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947219:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620283.947298:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788620283.947303:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620283.947325:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947349:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947359:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947378:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947385:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947391:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.947395:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947404:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947415:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620283.947418:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620283.947422:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947427:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947442:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947447:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947453:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947458:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620283.947467:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947474:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947482:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0d65309e700) 00010000:00010000:0.0:1788620283.947484:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620283.947488:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947493:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947544:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0d81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2477 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947559:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2477 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620283.947567:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620283.947569:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620283.947572:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642600, rc 0) 00000100:00100000:0.0:1788620283.947646:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:10530:x1875504045025024:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 18755us (19282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620283.947654:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 129 00010000:00010000:2.0:1788620284.215032:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788620284.362553:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1788620284.362572:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788620284.362584:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1788620284.362596:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:1.0:1788620284.908921:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788620284.908932:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788620284.909007:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788620284.909018:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788620284.909155:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e2b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061809920:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788620284.909284:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d647db23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620284.922298:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620284.922351:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045025536 00000100:00100000:3.0:1788620284.922359:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045025536 00000100:00100000:3.0:1788620284.922426:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 130 00000100:00100000:3.0:1788620284.922437:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:10541:x1875504045025536:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788620284.922472:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788620284.922582:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:10541:x1875504045025536:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 148us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620284.922591:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 130 00000100:00080000:3.0:1788620284.922618:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620284.923097:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e2b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061809920:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788620284.935774:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620284.936148:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045025792 00000100:00100000:2.0:1788620284.936159:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045025792 00000100:00100000:2.0:1788620284.936214:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 131 00000100:00100000:2.0:1788620284.936223:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:10541:x1875504045025792:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620284.936241:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620284.936283:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0d9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b247e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620284.936377:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620284.936390:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620284.936412:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620284.936424:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788620284.936542:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0d9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b247e expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620284.936557:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b247e expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620284.936566:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620284.936569:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620284.936573:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3200, rc 0) 00000100:00100000:2.0:1788620284.936628:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:10541:x1875504045025792:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 405us (863us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788620284.936634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 131 00000100:00100000:0.0:1788620284.951203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620284.951365:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620284.951451:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045026048 00000100:00100000:3.0:1788620284.951460:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045026048 00000100:00100000:3.0:1788620284.951522:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 132 00000100:00100000:3.0:1788620284.951532:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:10541:x1875504045026048:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788620284.951727:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.951745:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.951757:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.951966:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.951974:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.951982:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.952007:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620284.952011:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.952018:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.952031:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620284.952034:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788620284.952038:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620284.952044:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0db2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620284.952194:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:10541:x1875504045026048:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 662us (1000us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788620284.952203:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 132 00000040:00080000:0.0:1788620284.952514:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788620284.952524:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620284.953018:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788620284.953027:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788620284.954325:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045026176 00000100:00100000:1.0:1788620284.954347:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045026176 00000100:00100000:1.0:1788620284.954413:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:1.0:1788620284.954423:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:2353:x1875504045026176:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620284.954437:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620284.954459:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b247e expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620284.954475:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:1.0:1788620284.954480:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620284.954530:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645180000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:2353:x1875504045026176:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 109us (3165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620284.954537:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:3.0:1788620284.956097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620284.956212:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045026432 00000100:00100000:3.0:1788620284.956220:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045026432 00000100:00100000:3.0:1788620284.956324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:3.0:1788620284.956333:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:10541:x1875504045026432:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788620284.956538:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:10541:x1875504045026432:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 205us (446us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788620284.956546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 34 00010000:00010000:1.0:1788620285.229939:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788620285.240541:0:12050:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620285.240556:0:12050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620285.240606:0:12050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788620285.241474:0:12050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788620285.438345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620285.438433:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045026688 00000100:00100000:2.0:1788620285.438443:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045026688 00000100:00100000:2.0:1788620285.438509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 133 00000100:00100000:2.0:1788620285.438519:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:10554:x1875504045026688:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620285.438546:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620285.438567:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0db9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2485 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620285.438766:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0dc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620285.438791:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620285.438803:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620285.438825:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788620285.438978:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0db9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2485 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620285.439443:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2485 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620285.439453:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:2.0:1788620285.439456:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788620285.439460:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2400, rc 0) 00000100:00100000:2.0:1788620285.439525:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:10554:x1875504045026688:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1006us (1192us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788620285.439532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 133 00000100:00100000:1.0:1788620285.441691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620285.442099:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045026816 00000100:00100000:3.0:1788620285.442108:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045026816 00000100:00100000:3.0:1788620285.442167:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 134 00000100:00100000:3.0:1788620285.442178:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:10554:x1875504045026816:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:3.0:1788620285.442241:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442278:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442288:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442313:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442320:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442326:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442332:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620285.442336:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442343:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442369:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:3.0:1788620285.442373:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620285.442378:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.442384:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643a00/0x24857de440bd0dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620285.442459:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:10554:x1875504045026816:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 283us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620285.442467:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 134 00000100:00100000:1.0:1788620285.572293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620285.572531:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045026944 00000100:00100000:3.0:1788620285.572542:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045026944 00000100:00100000:3.0:1788620285.572625:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:3.0:1788620285.572636:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504045026944:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:3.0:1788620285.572655:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620285.572675:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0dd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b248c expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620285.572701:0:7779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c2dfa, atime: 0x6a9c2df9, ctime: 0x6a9c2dfa, blocks: 0xb 00010000:00010000:3.0:1788620285.572720:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1788620285.572725:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620285.572735:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b248c expref: 7 pid: 7779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.572753:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b248c expref: 7 pid: 7779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620285.572790:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643a00, rc 0) 00000100:00100000:3.0:1788620285.572867:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045026944:12345-192.168.201.11@tcp:101:cat.0 Request processed in 233us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620285.572875:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00080000:1.0:1788620285.572939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620285.578444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620285.578537:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027072 00000100:00100000:3.0:1788620285.578548:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027072 00002000:00100000:3.0:1788620285.578618:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffffa0d666e04000 x1875504045027072/t0(0) o3->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:381/0 lens 488/0 e 0 to 0 dl 1788620296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620285.578629:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d666e04000 with x1875504045027072 ext(0->4095) 00002000:00010000:3.0:1788620285.578635:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d666e04000 00000100:00100000:3.0:1788620285.578667:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:3.0:1788620285.578676:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045027072:12345-192.168.201.11@tcp:3:cat.0 00000100:00100000:3.0:1788620285.579414:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045027072:12345-192.168.201.11@tcp:3:cat.0 Request processed in 737us (980us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788620285.579423:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 3 00002000:00100000:3.0:1788620285.579430:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffffa0d666e04000 x1875504045027072/t0(0) o3->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:381/0 lens 488/4536 e 0 to 0 dl 1788620296 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788620285.579438:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d666e04000 with x1875504045027072 ext(0->4095) 00002000:00010000:3.0:1788620285.579442:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d666e04000 00010000:00010000:1.0:1788620286.253175:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620286.284876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620286.284924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620286.284966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620286.285074:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027200 00000100:00100000:2.0:1788620286.285083:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027200 00000100:00100000:2.0:1788620286.285190:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 284 00000100:00100000:2.0:1788620286.285200:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045027200:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620286.285289:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045027200:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 91us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620286.285297:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 284 00000100:00100000:1.0:1788620286.285828:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027328 00000100:00100000:1.0:1788620286.285834:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027328 00000100:00100000:1.0:1788620286.285882:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:1.0:1788620286.285889:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504045027328:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620286.285925:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504045027328:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 37us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620286.285932:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:3.0:1788620286.286179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027456 00000100:00100000:3.0:1788620286.286184:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027456 00000100:00100000:3.0:1788620286.286275:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 128 00000100:00100000:3.0:1788620286.286283:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504045027456:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620286.286320:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504045027456:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620286.286328:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 128 00000100:00080000:2.0:1788620286.286737:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788620286.286741:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620286.826559:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061810048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620286.826642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620286.826860:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810048 00000100:00100000:0.0:1788620286.826868:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810048 00000100:00100000:0.0:1788620286.826935:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788620286.826946:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061810048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620286.826999:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620286.827067:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061810048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620286.827076:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788620286.827099:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620286.827127:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788620286.827133:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1788620286.827166:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d67f815500, transno 4294967301 00000004:00080000:0.0:1788620286.827177:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788620286.827192:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d666e28700, transno 4294967304 00000100:00100000:0.0:1788620286.827205:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061810048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620286.827708:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061810560:0@lo:400:kworker.0 00000100:00100000:0.0:1788620286.827744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620286.827764:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788620286.827771:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061810176:0@lo:400:kworker.0 00000100:00100000:0.0:1788620286.827824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620286.827853:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061810688:0@lo:400:kworker.0 00000100:00100000:0.0:1788620286.827880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620286.827920:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810176 00000100:00100000:0.0:1788620286.827925:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810176 00000100:00100000:3.0:1788620286.828654:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810688 00000100:00100000:3.0:1788620286.828660:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810688 00000100:00100000:1.0:1788620286.828860:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810560 00000100:00100000:1.0:1788620286.828865:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810560 00000100:00100000:2.0:1788620286.828928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061810304:0@lo:400:kworker.0 00000100:00100000:2.0:1788620286.828975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620286.829002:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620286.829008:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061810432:0@lo:400:kworker.0 00000100:00100000:2.0:1788620286.829043:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620286.829072:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810304 00000100:00100000:2.0:1788620286.829076:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810304 00000100:00100000:2.0:1788620286.829104:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810432 00000100:00100000:2.0:1788620286.829107:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810432 00000100:00100000:1.0:1788620286.831723:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788620286.831751:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061810560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620286.831817:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788620286.831828:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061810304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620286.831852:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061810560:12345-0@lo:400:kworker.0 Request processed in 105us (4106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620286.831861:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788620286.831910:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620286.831916:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620286.831930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788620286.831939:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061810176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620286.831988:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061810176:12345-0@lo:400:kworker.0 Request processed in 51us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620286.831995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788620286.832062:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061810176:0@lo:400:kworker.0 00000100:00100000:1.0:1788620286.832078:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061810560:0@lo:400:kworker.0 00000100:00100000:3.0:1788620286.832169:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061810304:12345-0@lo:400:kworker.0 Request processed in 343us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620286.832175:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788620286.832192:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788620286.832200:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061810688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620286.832231:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061810688:12345-0@lo:400:kworker.0 Request processed in 32us (4350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620286.832237:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788620286.832515:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788620286.832523:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061810432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620286.832568:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061810432:12345-0@lo:400:kworker.0 Request processed in 46us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620286.832575:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788620286.832719:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061810432:0@lo:400:kworker.0 00000100:00100000:1.0:1788620286.832732:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061810304:0@lo:400:kworker.0 00000100:00100000:1.0:1788620286.832763:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061810688:0@lo:400:kworker.0 00010000:00010000:2.0:1788620287.273364:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620287.337432:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620287.337455:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061810816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620287.337525:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620287.337667:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810816 00000100:00100000:0.0:1788620287.337676:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810816 00000100:00100000:0.0:1788620287.337733:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788620287.337742:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875504061810816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620287.337775:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620287.337828:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875504061810816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620287.337835:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788620287.338025:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061810816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788620288.297036:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788620288.997886:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:0.0:1788620288.997900:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d67a119b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788620288.997905:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d650626600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d67a1196c0 00000020:00080000:0.0:1788620288.997908:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d650626000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d6819cb800 00000001:00080000:0.0:1788620288.997941:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:0.0:1788620288.997952:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788620288.997969:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788620288.997992:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788620288.998187:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1788620289.019716:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788620289.019733:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788620289.330167:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620290.344583:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620291.368388:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620291.420332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620291.420376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620291.420401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620291.420423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620291.420452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620291.420479:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045028096 00000100:00100000:2.0:1788620291.420489:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045028096 00000100:00100000:2.0:1788620291.420546:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027712 00000100:00100000:2.0:1788620291.420550:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027712 00000100:00100000:2.0:1788620291.420573:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 132 00000100:00100000:2.0:1788620291.420581:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045028096:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620291.420673:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045028096:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.420682:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 132 00000100:00100000:2.0:1788620291.420702:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 133 00000100:00100000:2.0:1788620291.420719:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2354:x1875504045027712:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620291.420747:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2354:x1875504045027712:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.420754:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 133 00000100:00100000:2.0:1788620291.420788:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027840 00000100:00100000:2.0:1788620291.420792:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027840 00000100:00100000:2.0:1788620291.420822:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027968 00000100:00100000:2.0:1788620291.420826:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027968 00000100:00100000:2.0:1788620291.420846:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:2.0:1788620291.420853:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504045027840:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620291.420881:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504045027840:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.420887:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:2.0:1788620291.420900:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00100000:2.0:1788620291.420905:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504045027968:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620291.420926:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504045027968:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 22us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.420932:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00080000:2.0:1788620291.420947:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620291.420951:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620291.420953:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620291.422038:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045027584 00000100:00100000:1.0:1788620291.422053:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045027584 00000100:00100000:1.0:1788620291.422094:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 286 00000100:00100000:1.0:1788620291.422102:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045027584:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620291.422152:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045027584:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 50us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620291.422159:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 286 00000100:00100000:2.0:1788620291.678738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620291.678837:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045028224 00000100:00100000:0.0:1788620291.678847:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045028224 00000100:00100000:0.0:1788620291.678906:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 135 00000100:00100000:0.0:1788620291.678918:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10216:x1875504045028224:12345-192.168.201.11@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788620291.679056:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10216:x1875504045028224:12345-192.168.201.11@tcp:60:lhsmtool_posix.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620291.679063:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 135 00000100:00100000:1.0:1788620291.682576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620291.682725:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045028480 00000100:00100000:3.0:1788620291.682736:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045028480 00000100:00100000:3.0:1788620291.682796:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:3.0:1788620291.682806:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:10216:x1875504045028480:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788620291.688966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:10216:x1875504045028480:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 6148us (6386us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788620291.688982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:1.0:1788620291.944495:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061810944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620291.944572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620291.944674:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061811072:0@lo:400:kworker.0 00000100:00100000:3.0:1788620291.944737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620291.944752:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061811328:0@lo:400:kworker.0 00000100:00100000:3.0:1788620291.944799:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061811584:0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.944799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620291.944837:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620291.944837:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620291.944846:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061811456:0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.944892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620291.944926:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061811200:0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.944933:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811328 00000100:00100000:2.0:1788620291.944940:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811328 00000100:00100000:1.0:1788620291.944955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620291.944979:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061811712:0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.944996:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811584 00000100:00100000:2.0:1788620291.945000:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811584 00000100:00100000:1.0:1788620291.945005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620291.945023:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811200 00000100:00100000:2.0:1788620291.945027:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811200 00000100:00100000:1.0:1788620291.945046:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811456 00000100:00100000:2.0:1788620291.945050:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788620291.945052:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811456 00000100:00100000:2.0:1788620291.945061:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061811328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620291.945087:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811712 00000100:00100000:1.0:1788620291.945091:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811712 00000100:00100000:1.0:1788620291.945121:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788620291.945123:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061811328:12345-0@lo:400:kworker.0 Request processed in 61us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620291.945131:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061811456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.945136:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788620291.945163:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788620291.945173:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061811456:12345-0@lo:400:kworker.0 Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.945174:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061811584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620291.945187:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788620291.945206:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788620291.945215:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061811712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.945222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061811584:12345-0@lo:400:kworker.0 Request processed in 49us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.945242:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788620291.945281:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061811712:12345-0@lo:400:kworker.0 Request processed in 68us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.945288:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788620291.945298:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061811200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620291.945301:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788620291.945359:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061811712:0@lo:400:kworker.0 00000100:00100000:0.0:1788620291.945600:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061810944 00000100:00100000:0.0:1788620291.945605:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061810944 00000100:00100000:0.0:1788620291.945633:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788620291.945640:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061810944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620291.945666:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620291.948715:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061811200:12345-0@lo:400:kworker.0 Request processed in 3399us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620291.948731:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1788620291.948778:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620291.948784:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788620291.948787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620291.948791:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061811200:0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.948822:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788620291.948829:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788620291.948845:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061811456:0@lo:400:kworker.0 00000100:00100000:2.0:1788620291.948860:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061811328:0@lo:400:kworker.0 00000100:00100000:1.0:1788620291.948962:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811072 00000100:00100000:1.0:1788620291.948971:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811072 00000100:00100000:1.0:1788620291.949020:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788620291.949028:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061811072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620291.949101:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061811072:12345-0@lo:400:kworker.0 Request processed in 73us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620291.949109:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788620291.949222:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061811584:0@lo:400:kworker.0 00000100:00100000:3.0:1788620291.949234:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061811072:0@lo:400:kworker.0 00000100:00100000:0.0:1788620291.949443:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061810944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3801us (4869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620291.949452:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788620291.949519:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061810944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620292.025584:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620292.026328:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045028608 00000100:00100000:2.0:1788620292.026339:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045028608 00000100:00100000:2.0:1788620292.026418:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 136 00000100:00100000:2.0:1788620292.026427:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08800a14-727c-477e-9a55-bbbe86f0530f+5:11007:x1875504045028608:12345-192.168.201.11@tcp:101:lsof.0 00010000:00010000:2.0:1788620292.026448:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620292.026468:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0ddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2493 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620292.026532:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620292.026547:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620292.026559:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620292.026788:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788620292.026798:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620292.026914:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620292.026943:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620292.026963:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620292.026973:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:2.0:1788620292.026976:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620292.026979:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2e00, rc 0) 00000100:00100000:2.0:1788620292.027053:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08800a14-727c-477e-9a55-bbbe86f0530f+6:11007:x1875504045028608:12345-192.168.201.11@tcp:101:lsof.0 Request processed in 627us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620292.027061:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 136 00010000:00010000:0.0:1788620292.392783:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620292.459623:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788620292.459656:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061811840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620292.459743:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620292.459818:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811840 00000100:00100000:1.0:1788620292.459828:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811840 00000100:00100000:1.0:1788620292.459897:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788620292.459908:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061811840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620292.459947:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620292.460025:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061811840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620292.460033:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788620292.460239:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061811840:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788620293.160635:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620293.160655:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620293.161874:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788620293.161886:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788620293.419074:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788620294.046424:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1788620294.046572:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788620294.046621:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788620294.046632:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788620294.441170:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620295.464488:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620296.488662:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788620296.501849:0:12253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:58:14 (1788620294) 00000100:00100000:1.0:1788620296.535123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620296.535167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620296.535203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620296.535223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620296.535304:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045028992 00000100:00100000:0.0:1788620296.535317:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045028992 00000100:00100000:0.0:1788620296.535381:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:0.0:1788620296.535391:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504045028992:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620296.535394:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620296.535424:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045029248 00000100:00100000:1.0:1788620296.535428:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045029248 00000100:00100000:1.0:1788620296.535462:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045028864 00000100:00100000:1.0:1788620296.535465:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045028864 00000100:00100000:0.0:1788620296.535475:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504045028992:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620296.535484:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:1.0:1788620296.535489:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 137 00000100:00100000:1.0:1788620296.535498:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+6:2356:x1875504045029248:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620296.535504:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045029120 00000100:00100000:0.0:1788620296.535514:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045029120 00000100:00100000:1.0:1788620296.535536:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+6:2356:x1875504045029248:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620296.535544:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 66 00000100:00100000:1.0:1788620296.535546:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 137 00000100:00100000:0.0:1788620296.535556:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2356:x1875504045029120:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620296.535586:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 138 00000100:00100000:0.0:1788620296.535587:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2356:x1875504045029120:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620296.535599:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 66 00000100:00100000:1.0:1788620296.535600:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2356:x1875504045028864:12345-192.168.201.11@tcp:400:kworker.0 00000100:00080000:0.0:1788620296.535630:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620296.535635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620296.535638:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620296.535652:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2356:x1875504045028864:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 57us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620296.535659:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 138 00000100:00100000:2.0:1788620296.536389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045028736 00000100:00100000:2.0:1788620296.536396:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045028736 00000100:00100000:2.0:1788620296.536454:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 288 00000100:00100000:2.0:1788620296.536463:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504045028736:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620296.536506:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2356:x1875504045028736:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 44us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620296.536513:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 288 00000100:00100000:1.0:1788620297.064656:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061811968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620297.064995:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061812352:0@lo:400:kworker.0 00000100:00100000:0.0:1788620297.065026:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620297.065084:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788620297.065090:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061812480:0@lo:400:kworker.0 00000100:00100000:0.0:1788620297.065111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620297.065149:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061812352 00000100:00100000:0.0:1788620297.065156:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061812352 00000100:00100000:0.0:1788620297.065203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788620297.065212:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061812352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620297.065275:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061812352:12345-0@lo:400:kworker.0 Request processed in 65us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620297.065283:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788620297.065301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620297.065460:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061812096:0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620297.065513:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061812608:0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065532:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620297.065547:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788620297.065552:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061812224:0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065571:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620297.065587:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061812736:0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620297.065662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061812608 00000100:00100000:3.0:1788620297.065666:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061812608 00000100:00100000:3.0:1788620297.065694:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061812224 00000100:00100000:3.0:1788620297.065696:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061812224 00000100:00100000:3.0:1788620297.065708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788620297.065713:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061812608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065751:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061812608:12345-0@lo:400:kworker.0 Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620297.065757:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788620297.065772:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788620297.065778:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061812224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065799:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061812224:12345-0@lo:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620297.065804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788620297.065815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620297.065836:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061812224:0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065845:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061812608:0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065879:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061812096 00000100:00100000:3.0:1788620297.065882:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061812096 00000100:00100000:3.0:1788620297.065901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788620297.065907:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061812096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.065936:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061812096:12345-0@lo:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620297.065942:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788620297.065966:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061812480 00000100:00100000:3.0:1788620297.065969:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061812480 00000100:00100000:3.0:1788620297.065992:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061812736 00000100:00100000:3.0:1788620297.065995:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061812736 00000100:00100000:3.0:1788620297.066009:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788620297.066015:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061812480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.066040:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061812480:12345-0@lo:400:kworker.0 Request processed in 25us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620297.066052:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788620297.066062:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788620297.066068:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061812736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.066091:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061812736:12345-0@lo:400:kworker.0 Request processed in 23us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620297.066097:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788620297.066107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620297.066109:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620297.066122:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061812736:0@lo:400:kworker.0 00000100:00100000:3.0:1788620297.066130:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061812096:0@lo:400:kworker.0 00000100:00100000:0.0:1788620297.066955:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061812352:0@lo:400:kworker.0 00000100:00100000:0.0:1788620297.067794:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061812480:0@lo:400:kworker.0 00000100:00100000:1.0:1788620297.067863:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620297.071779:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061811968 00000100:00100000:0.0:1788620297.071794:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061811968 00000100:00100000:0.0:1788620297.071887:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788620297.071896:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061811968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620297.071937:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620297.072026:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061811968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (7299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620297.072034:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620297.072117:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061811968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788620297.512700:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620297.576493:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061812864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620297.576559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620297.580722:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061812864 00000100:00100000:2.0:1788620297.580736:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061812864 00000100:00100000:2.0:1788620297.580816:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788620297.580825:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061812864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620297.580863:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620297.580951:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061812864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620297.580959:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788620297.581076:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061812864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620298.124748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620298.124815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045029504 00000100:00100000:3.0:1788620298.124827:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045029504 00000100:00080000:0.0:1788620298.124909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620298.124920:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 137 00000100:00100000:3.0:1788620298.124934:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:11273:x1875504045029504:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620298.124955:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620298.124979:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0dea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b249a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.125055:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.125069:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.125100:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.125148:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.125157:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.125164:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127621:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0dff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127642:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0dff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127653:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0dff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620298.127666:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788620298.127882:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127890:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127897:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127903:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620298.127915:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127923:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127936:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0d65309e600) 00010000:00010000:3.0:1788620298.127939:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620298.127944:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127951:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0df1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127966:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127972:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127977:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127982:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620298.127985:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127990:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.127998:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0d65309e800) 00010000:00010000:3.0:1788620298.128001:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620298.128009:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.128016:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0df8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.128426:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0dea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b249a expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.128444:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0dff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b249a expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.128452:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:3.0:1788620298.128455:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620298.128458:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643200, rc 0) 00000100:00100000:3.0:1788620298.128527:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:11273:x1875504045029504:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 3596us (3787us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788620298.128536:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 137 00000100:00100000:1.0:1788620298.131138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620298.131620:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045029632 00000100:00100000:3.0:1788620298.131630:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045029632 00000100:00100000:3.0:1788620298.131687:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:3.0:1788620298.131697:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:2355:x1875504045029632:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620298.131713:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620298.131737:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0dff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b249a expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620298.131756:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:3.0:1788620298.131761:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620298.131849:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:2355:x1875504045029632:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 152us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620298.131857:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620298.140967:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620298.141020:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045029760 00000100:00100000:3.0:1788620298.141030:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045029760 00000100:00100000:3.0:1788620298.141091:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 138 00000100:00100000:3.0:1788620298.141102:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:11273:x1875504045029760:12345-192.168.201.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788620298.141219:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:11273:x1875504045029760:12345-192.168.201.11@tcp:59:lhsmtool_posix.0 Request processed in 118us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620298.141227:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 138 00000040:00080000:3.0:1788620298.280699:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620298.280710:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620298.280746:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788620298.280753:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788620298.540700:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788620299.176128:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1788620299.575184:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620300.586984:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620300.888290:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620300.888362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045029888 00000100:00100000:3.0:1788620300.888372:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045029888 00000100:00100000:3.0:1788620300.888445:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 139 00000100:00100000:3.0:1788620300.888455:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:11315:x1875504045029888:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620300.888476:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620300.888495:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888564:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888579:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888597:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888611:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888618:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888625:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888874:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888882:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888888:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888894:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620300.888898:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888905:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888918:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:3.0:1788620300.888921:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620300.888925:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888937:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0e14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888950:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888956:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888962:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888967:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620300.888970:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888976:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888983:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0d65309e800) 00010000:00010000:3.0:1788620300.888986:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620300.888988:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.888995:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd0e1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.889026:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0e0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24a1 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.889045:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:3.0:1788620300.889047:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620300.889052:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24a1 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.889061:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643200, rc 0) 00000100:00100000:3.0:1788620300.889115:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:11315:x1875504045029888:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 662us (834us total) trans 0 rc 301/301 00000100:00100000:3.0:1788620300.889122:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 139 00000100:00080000:0.0:1788620300.889360:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620300.899243:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620300.899536:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045030144 00000100:00100000:1.0:1788620300.899558:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045030144 00000100:00100000:1.0:1788620300.899644:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 140 00000100:00100000:1.0:1788620300.899655:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:11315:x1875504045030144:12345-192.168.201.11@tcp:36:lfs.0 00010000:00010000:1.0:1788620300.899705:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620300.899730:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925c00/0x24857de440bd078b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22da expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.899758:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:1.0:1788620300.899763:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788620300.899997:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.900012:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.900022:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.900125:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.900141:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 5 pid: 5840 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620300.900155:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061812992:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620300.900241:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680824b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620300.904496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620300.904557:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045030272 00000100:00100000:3.0:1788620300.904567:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045030272 00010000:00010000:3.0:1788620300.904632:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 6 pid: 5840 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620300.904670:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:3.0:1788620300.904680:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08800a14-727c-477e-9a55-bbbe86f0530f+6:2355:x1875504045030272:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620300.904694:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620300.904701:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 6 pid: 5840 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.904715:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 6 pid: 5840 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.904889:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:3.0:1788620300.904902:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.904914:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.904921:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620300.904944:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620300.905002:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08800a14-727c-477e-9a55-bbbe86f0530f+6:2355:x1875504045030272:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 323us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620300.905010:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00080000:3.0:1788620300.905047:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788620300.907664:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2493 expref: 5 pid: 5840 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620300.907685:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061812992:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620300.907713:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.907723:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.907737:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.907942:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.907956:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.907967:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620300.909540:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788620300.909642:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.909656:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.909664:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.909670:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620300.909675:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.909683:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.909697:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d65309e900) 00010000:00010000:2.0:1788620300.909700:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620300.909704:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.909710:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0e22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620300.909947:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1f1d093 reply state 00000000997302fa transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620300.909957:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620300.910063:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:11315:x1875504045030144:12345-192.168.201.11@tcp:36:lfs.0 Request processed in 10407us (10826us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788620300.910073:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 140 00010000:00010000:0.0:1788620300.915868:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620300.915886:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620300.915895:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620300.915901:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620300.915905:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620300.915913:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620300.915938:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0d647f7ca00) 00010000:00010000:0.0:1788620300.915941:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620300.915946:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620300.915953:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e29 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620300.958119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620300.958289:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045030400 00000100:00100000:1.0:1788620300.958300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045030400 00000100:00100000:1.0:1788620300.958355:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 141 00000100:00100000:1.0:1788620300.958366:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:11323:x1875504045030400:12345-192.168.201.11@tcp:101:lctl.0 00010000:00010000:1.0:1788620300.958400:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620300.958424:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24a8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.958502:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.958516:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.958528:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620300.958598:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788620300.958601:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620300.958625:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.958649:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24a8 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.958667:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24a8 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.958676:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:1.0:1788620300.958679:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788620300.958683:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548c00, rc 0) 00000100:00100000:1.0:1788620300.958737:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:11323:x1875504045030400:12345-192.168.201.11@tcp:101:lctl.0 Request processed in 373us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620300.958745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 141 00000100:00100000:1.0:1788620300.986116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620300.989710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045030528 00000100:00100000:2.0:1788620300.989723:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045030528 00000100:00100000:2.0:1788620300.989792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 142 00000100:00100000:2.0:1788620300.989803:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:11329:x1875504045030528:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:2.0:1788620300.989822:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620300.989841:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0e3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24af expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.989903:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.989917:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.989930:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.989946:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.989953:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.989959:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990055:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990064:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990070:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620300.990108:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788620300.990112:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620300.990131:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990142:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990149:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990155:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990161:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620300.990165:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990173:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990184:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:2.0:1788620300.990187:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620300.990191:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990198:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990209:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990225:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990231:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990236:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620300.990239:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990245:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990281:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0d647f7c700) 00010000:00010000:2.0:1788620300.990284:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620300.990288:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990295:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0e4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990323:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0e3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24af expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990335:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24af expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620300.990343:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620300.990345:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788620300.990352:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3200, rc 0) 00000100:00100000:2.0:1788620300.991535:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:11329:x1875504045030528:12345-192.168.201.11@tcp:101:bash.0 Request processed in 1726us (5418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620300.991556:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 142 00000100:00100000:0.0:1788620300.996716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620300.997314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045030784 00000100:00100000:1.0:1788620300.997333:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045030784 00000100:00100000:1.0:1788620300.997391:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 143 00000100:00100000:1.0:1788620300.997402:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+15:11329:x1875504045030784:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:1.0:1788620300.997419:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620300.997438:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0e5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24b6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.997578:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.997593:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.997605:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.997654:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.997662:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.997669:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788620300.998166:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788620300.998370:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998382:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998401:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998436:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998444:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998451:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998458:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620300.998462:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998470:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998483:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620300.998486:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620300.998490:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998496:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0e61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620300.998509:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000249f39da reply state 00000000ff4392a8 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620300.998519:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788620300.998567:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0e5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998583:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620300.998590:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2100) 00010000:00010000:1.0:1788620300.998593:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620300.998596:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548400, rc 0) 00000100:00100000:1.0:1788620300.998659:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11329:x1875504045030784:12345-192.168.201.11@tcp:101:bash.0 Request processed in 1259us (1952us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788620300.998667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 143 00010000:00010000:3.0:1788620301.000086:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.000108:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.000116:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.000122:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620301.000126:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.000133:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.000146:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d64c7c2400) 00010000:00010000:3.0:1788620301.000149:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620301.000164:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.000171:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0e68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.002063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.002111:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045030912 00000100:00100000:1.0:1788620301.002121:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045030912 00000100:00100000:1.0:1788620301.002369:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:1.0:1788620301.002380:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2355:x1875504045030912:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:1.0:1788620301.002397:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620301.002417:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24bd expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620301.002443:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:3.0:1788620301.002457:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788620301.002462:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1788620301.002468:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620301.002478:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 6 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.002497:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 6 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.002520:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620301.002592:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045030912:12345-192.168.201.11@tcp:101:bash.0 Request processed in 212us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.002600:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:0.0:1788620301.005072:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.005123:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045031040 00000100:00100000:3.0:1788620301.005133:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045031040 00000100:00100000:3.0:1788620301.005186:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:3.0:1788620301.005196:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:11329:x1875504045031040:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:3.0:1788620301.005214:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620301.005230:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24c4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.005501:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.005512:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620301.005517:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620301.005523:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.005572:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.005589:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 7 pid: 12010 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620301.005624:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d649f21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875504061813120:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620301.005720:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d651472d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620301.007915:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d649f21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875504061813120:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620301.007927:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00010000:00010000:1.0:1788620301.007951:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.007971:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642e00, rc 0) 00000100:00100000:1.0:1788620301.008025:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:11329:x1875504045031040:12345-192.168.201.11@tcp:101:bash.0 Request processed in 2829us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.008034:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:0.0:1788620301.008113:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045031168 00000100:00100000:0.0:1788620301.008120:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045031168 00010000:00010000:0.0:1788620301.008155:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 7 pid: 12010 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.008187:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:0.0:1788620301.008195:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045031168:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620301.008207:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620301.008227:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 7 pid: 12010 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.008240:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 7 pid: 12010 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.008304:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab5807e/0x24857de440bd0e7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24bd expref: 7 pid: 12010 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.008330:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620301.008335:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620301.008343:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.008353:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.008381:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.008394:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875504061813248:192.168.201.11@tcp:105: 00000100:00100000:0.0:1788620301.008438:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a1190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620301.010763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.010845:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045031424 00000100:00100000:2.0:1788620301.010854:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045031424 00000100:00100000:2.0:1788620301.010973:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:2.0:1788620301.010985:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:11329:x1875504045031424:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:2.0:1788620301.011354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11329:x1875504045031424:12345-192.168.201.11@tcp:35:bash.0 Request processed in 370us (599us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788620301.011435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:3.0:1788620301.012463:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875504061813248:192.168.201.11@tcp:105: 00010000:00010000:3.0:1788620301.012484:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620301.012572:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045031168:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 4376us (4649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620301.012582:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:0.0:1788620301.065658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.065732:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045031680 00000100:00100000:3.0:1788620301.065741:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045031680 00000100:00100000:3.0:1788620301.065791:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 144 00000100:00100000:3.0:1788620301.065798:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11339:x1875504045031680:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620301.065823:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620301.065839:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24cb expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620301.065956:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788620301.066054:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0e8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24cb expref: 20 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.066069:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:3.0:1788620301.066072:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620301.066077:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24cb expref: 20 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.066112:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643200, rc 0) 00000100:00100000:3.0:1788620301.066172:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:11339:x1875504045031680:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 374us (521us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788620301.066178:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 144 00000100:00100000:0.0:1788620301.068808:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.068979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045031936 00000100:00100000:1.0:1788620301.068989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045031936 00000100:00100000:1.0:1788620301.069031:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:1.0:1788620301.069037:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:11339:x1875504045031936:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620301.069718:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:11339:x1875504045031936:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 676us (916us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788620301.069727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:0.0:1788620301.132642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.132826:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045032064 00000100:00100000:2.0:1788620301.132836:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045032064 00000100:00100000:2.0:1788620301.132977:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 145 00000100:00100000:2.0:1788620301.132987:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:11345:x1875504045032064:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620301.133008:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620301.133025:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.133093:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.133107:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.133118:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620301.133170:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788620301.133186:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620301.133205:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.133225:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24d2 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.133238:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24d2 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.133245:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620301.133247:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620301.133289:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2200, rc 0) 00000100:00100000:2.0:1788620301.133363:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:11345:x1875504045032064:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 376us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620301.133374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 145 00000100:00100000:3.0:1788620301.136429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.136552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045032320 00000100:00100000:1.0:1788620301.136564:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045032320 00000100:00100000:1.0:1788620301.136633:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 146 00000100:00100000:1.0:1788620301.136645:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:11345:x1875504045032320:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620301.136666:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620301.136689:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24d9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.136817:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.136829:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.136839:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620301.136848:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788620301.137002:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24d9 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.137018:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24d9 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.137024:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2100) 00010000:00010000:1.0:1788620301.137027:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620301.137030:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620301.137335:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:11345:x1875504045032320:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 682us (902us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788620301.137343:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 146 00000100:00100000:3.0:1788620301.142830:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.142889:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620301.143128:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045032704 00000100:00100000:0.0:1788620301.143137:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045032704 00000100:00100000:0.0:1788620301.143201:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620301.143211:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:2355:x1875504045032704:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620301.143241:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620301.143299:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24d9 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.143319:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2100) 00010000:00010000:0.0:1788620301.143330:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620301.143376:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:2355:x1875504045032704:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 167us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620301.143384:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:1.0:1788620301.144280:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045032576 00000100:00100000:1.0:1788620301.144290:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045032576 00000100:00100000:1.0:1788620301.144341:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 147 00000100:00100000:1.0:1788620301.144350:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:11345:x1875504045032576:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620301.144382:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620301.144414:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0ebc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.144533:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0ec3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.144557:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.144568:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620301.144581:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788620301.144697:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0ebc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24e0 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.145131:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24e0 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.145140:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2100) 00010000:00010000:1.0:1788620301.145142:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788620301.145144:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620301.145201:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11345:x1875504045032576:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 852us (2310us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788620301.145209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 147 00000100:00100000:3.0:1788620301.151114:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620301.151399:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045032832 00000100:00100000:0.0:1788620301.151409:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045032832 00000100:00100000:0.0:1788620301.151501:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:0.0:1788620301.151512:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2356:x1875504045032832:12345-192.168.201.11@tcp:1:lfs.0 00010000:00010000:0.0:1788620301.151582:0:7779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.151608:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.151617:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620301.151622:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620301.151627:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.151663:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.151697:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 6 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.151713:0:7779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1875504061813376:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620301.151820:0:7779:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620301.154134:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.154640:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045032960 00000100:00100000:2.0:1788620301.154649:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045032960 00002000:00100000:2.0:1788620301.154697:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0d67a11dc00 x1875504045032960/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:397/0 lens 504/0 e 0 to 0 dl 1788620312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788620301.154709:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d67a11dc00 with x1875504045032960 ext(0->12) 00010000:00010000:2.0:1788620301.154727:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 7 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.154740:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 7 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620301.154745:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d67a11dc00 00000100:00100000:2.0:1788620301.154786:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:2.0:1788620301.154796:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045032960:12345-192.168.201.11@tcp:4:lfs.0 00000100:00100000:2.0:1788620301.155289:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504045032960:12345-192.168.201.11@tcp:4:lfs.0 Request processed in 493us (1163us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788620301.155297:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00002000:00100000:2.0:1788620301.155304:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0d67a11dc00 x1875504045032960/t4294967305(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:397/0 lens 504/448 e 0 to 0 dl 1788620312 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788620301.155313:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d67a11dc00 with x1875504045032960 ext(0->12) 00010000:00010000:2.0:1788620301.155319:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.155425:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620301.155433:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d67a11dc00 00000100:00100000:0.0:1788620301.155962:0:7779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1875504061813376:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620301.155983:0:7779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620301.158415:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.158478:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045033088 00000100:00100000:1.0:1788620301.158489:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045033088 00010000:00010000:1.0:1788620301.158528:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620301.158608:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00100000:1.0:1788620301.158617:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2353:x1875504045033088:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620301.158630:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788620301.158647:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788620301.158649:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788620300 00002000:00010000:1.0:1788620301.158651:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788620300 00002000:00010000:1.0:1788620301.158652:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788620300 00010000:00010000:1.0:1788620301.158656:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.158666:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.158685:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005871b9a3/0x24857de440bd0e84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24c4 expref: 9 pid: 6686 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.158698:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620301.158701:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620301.158706:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.158826:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.158910:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620301.158981:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2353:x1875504045033088:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 360us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.158990:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 62 00010000:00010000:0.0:1788620301.159497:0:7779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159508:0:7779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159534:0:7779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159553:0:7779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159561:0:7779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159581:0:7779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620301.159586:0:7779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159596:0:7779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159608:0:7779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.159613:0:7779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd0ed1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.159668:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a11ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045032832:12345-192.168.201.11@tcp:1:lfs.0 Request processed in 8157us (8565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620301.159676:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:3.0:1788620301.161211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.161298:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045033344 00000100:00100000:2.0:1788620301.161308:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045033344 00000100:00100000:2.0:1788620301.161463:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:2.0:1788620301.161470:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11345:x1875504045033344:12345-192.168.201.11@tcp:35:lfs.0 00000004:00010000:2.0:1788620301.161529:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24e0 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620301.161778:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788620301.161807:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788620301.162675:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788620301.162736:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.162762:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.162772:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.162810:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.162826:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 28 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620301.162838:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666ff4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061813504:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620301.163158:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620301.165422:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.165635:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045033472 00000100:00100000:1.0:1788620301.165644:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045033472 00010000:00010000:1.0:1788620301.165684:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 29 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620301.165721:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 63 00000100:00100000:1.0:1788620301.165728:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:2355:x1875504045033472:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620301.165739:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620301.165744:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 29 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.165753:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 29 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.165771:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2100) 00010000:00010000:1.0:1788620301.165775:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.165782:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.165786:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.165803:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620301.165842:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:2355:x1875504045033472:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.165870:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 63 00010000:00010000:0.0:1788620301.166372:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0e6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24b6 expref: 28 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.166387:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666ff4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061813504:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620301.166402:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.166407:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.166420:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620301.166530:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788620301.166759:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788620301.166875:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061813632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788620301.166921:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620301.166952:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620301.167529:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061813632 00000100:00100000:1.0:1788620301.167537:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061813632 00000100:00100000:1.0:1788620301.167595:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620301.167604:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061813632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788620301.167683:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061813632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.167692:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788620301.167965:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620301.168041:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061813632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788620301.168454:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788620301.168511:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061813760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788620301.168555:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620301.168579:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119000 going to sleep for 11 seconds 00000100:00100000:1.0:1788620301.168901:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061813760 00000100:00100000:1.0:1788620301.168907:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061813760 00000100:00100000:1.0:1788620301.168938:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620301.168946:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061813760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788620301.169089:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875504061813760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (532us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788620301.169096:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620301.169238:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061813760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788620301.169318:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788620301.169360:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.169368:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.169373:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.169376:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620301.169380:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.169395:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.169408:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2100) 00010000:00010000:0.0:1788620301.169410:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788620301.169414:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.169418:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd0ed8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620301.169580:0:5842:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788620301.169683:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788620301.169693:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351208442579ns, next at 352208441139ns, rc = 0 00000001:00080000:0.0:1788620301.169698:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788620301.169937:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2100) 00010000:00010000:0.0:1788620301.169940:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788620301.169948:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0ec3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24e0 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.170044:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:11345:x1875504045033344:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 8574us (8839us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788620301.170050:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 38 00000020:00080000:0.0:1788620301.170053:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788620301.171829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.172484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045033600 00000100:00100000:1.0:1788620301.172498:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045033600 00000100:00100000:1.0:1788620301.172602:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 148 00000100:00100000:1.0:1788620301.172614:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:11345:x1875504045033600:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620301.172641:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620301.172659:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.172733:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24e7 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.172765:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24e7 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.172782:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620301.172784:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788620301.172787:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548600, rc 0) 00000100:00100000:1.0:1788620301.172847:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:11345:x1875504045033600:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 237us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.172852:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 148 00000100:00100000:3.0:1788620301.174834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620301.175006:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045033856 00000100:00100000:0.0:1788620301.175013:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045033856 00000100:00100000:0.0:1788620301.175049:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:0.0:1788620301.175056:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:11345:x1875504045033856:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620301.175277:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+33:11345:x1875504045033856:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 221us (451us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788620301.175283:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:3.0:1788620301.231536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.231795:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045034112 00000100:00100000:2.0:1788620301.231805:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045034112 00000100:00100000:2.0:1788620301.231881:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 149 00000100:00100000:2.0:1788620301.231892:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+33:11355:x1875504045034112:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620301.231917:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620301.231939:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24ee expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620301.232058:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788620301.232165:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ee6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24ee expref: 35 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.232179:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:2.0:1788620301.232195:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620301.232200:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24ee expref: 35 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.232210:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2e00, rc 0) 00000100:00100000:2.0:1788620301.232310:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11355:x1875504045034112:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 420us (788us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788620301.232316:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 149 00000100:00100000:0.0:1788620301.235204:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.235362:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045034240 00000100:00100000:2.0:1788620301.235374:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045034240 00000100:00100000:2.0:1788620301.235626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 150 00000100:00100000:2.0:1788620301.235635:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11355:x1875504045034240:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:2.0:1788620301.235698:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235710:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235728:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235742:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235749:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235756:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235852:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235875:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235882:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620301.235940:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235953:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235960:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235968:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235974:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620301.235978:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235986:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.235999:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620301.236003:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620301.236009:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236016:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236035:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236038:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236042:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236045:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620301.236047:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236050:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236055:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620301.236056:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620301.236058:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236061:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236070:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236073:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236076:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236083:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620301.236085:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236089:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236093:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620301.236094:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620301.236096:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.236099:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620301.236173:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11355:x1875504045034240:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 538us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620301.236180:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 150 00000100:00100000:3.0:1788620301.238446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620301.238706:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045034496 00000100:00100000:0.0:1788620301.238759:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045034496 00000100:00100000:0.0:1788620301.238836:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 40 00000100:00100000:0.0:1788620301.238845:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11355:x1875504045034496:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620301.239173:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:11355:x1875504045034496:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 327us (736us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788620301.239182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 40 00000100:00100000:3.0:1788620301.271145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.271372:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045034752 00000100:00100000:2.0:1788620301.271383:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045034752 00000100:00100000:2.0:1788620301.271507:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 151 00000100:00100000:2.0:1788620301.271518:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:11358:x1875504045034752:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620301.271553:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620301.271573:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24f5 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271643:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271672:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271681:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271692:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271697:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271701:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271825:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271833:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271839:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620301.271849:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788620301.271949:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271957:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271963:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271976:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620301.271981:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.271989:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272002:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620301.272005:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620301.272011:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272017:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272031:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272037:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272043:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272047:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620301.272050:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272056:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272076:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620301.272078:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620301.272081:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272087:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd0f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272133:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd0f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 38 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272148:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 37 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.272155:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620301.272157:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620301.272159:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2e00, rc 0) 00000100:00100000:2.0:1788620301.272233:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:11358:x1875504045034752:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 716us (1099us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788620301.272241:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 151 00000100:00100000:1.0:1788620301.279335:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.279876:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045034880 00000100:00100000:3.0:1788620301.279889:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045034880 00000100:00100000:3.0:1788620301.279948:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 152 00000100:00100000:3.0:1788620301.279960:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:11358:x1875504045034880:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:3.0:1788620301.280372:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280389:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280416:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280443:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280450:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280457:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280463:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620301.280467:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280474:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280699:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620301.280703:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620301.280708:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.280839:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620301.280928:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:11358:x1875504045034880:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 969us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620301.280937:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 152 00000100:00100000:3.0:1788620301.285110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620301.285224:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045035136 00000100:00100000:0.0:1788620301.285234:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045035136 00000100:00100000:0.0:1788620301.285572:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 41 00000100:00100000:0.0:1788620301.285586:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:11358:x1875504045035136:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620301.285945:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:11358:x1875504045035136:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 360us (843us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788620301.285954:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 41 00000100:00100000:1.0:1788620301.541390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.542808:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045035392 00000100:00100000:3.0:1788620301.542822:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045035392 00000100:00100000:3.0:1788620301.542902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 153 00000100:00100000:3.0:1788620301.542912:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:11389:x1875504045035392:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:3.0:1788620301.542936:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620301.542956:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b24fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.543061:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.543075:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.543087:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620301.543098:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788620301.543231:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd0f33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24fc expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.543309:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24fc expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.543319:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620301.543322:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620301.543326:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643200, rc 0) 00000100:00100000:3.0:1788620301.543402:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:11389:x1875504045035392:12345-192.168.201.11@tcp:101:cat.0 Request processed in 491us (2021us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788620301.544842:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 153 00000100:00100000:1.0:1788620301.552191:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.552315:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620301.552625:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045035520 00000100:00100000:0.0:1788620301.552637:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045035520 00000100:00100000:0.0:1788620301.552707:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:0.0:1788620301.552719:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:2355:x1875504045035520:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620301.552737:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620301.552763:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd0f3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24fc expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.552799:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620301.552803:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620301.552876:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:2355:x1875504045035520:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 147us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620301.552885:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:3.0:1788620301.553743:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045035776 00000100:00100000:3.0:1788620301.553752:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045035776 00000100:00100000:3.0:1788620301.553792:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 42 00000100:00100000:3.0:1788620301.553800:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:11389:x1875504045035776:12345-192.168.201.11@tcp:35:cat.0 00000100:00100000:3.0:1788620301.554029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:11389:x1875504045035776:12345-192.168.201.11@tcp:35:cat.0 Request processed in 229us (1849us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788620301.554037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 42 00010000:00010000:0.0:1788620301.610207:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620301.636577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.637083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045036032 00000100:00100000:3.0:1788620301.637094:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045036032 00000100:00100000:3.0:1788620301.637160:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 154 00000100:00100000:3.0:1788620301.637171:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:11395:x1875504045036032:12345-192.168.201.11@tcp:101:dd.0 00010000:00010000:3.0:1788620301.637196:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620301.637200:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788620301.637230:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2200/0x24857de440bd0ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24d2 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.637735:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:3.0:1788620301.637742:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620301.637817:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0f48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2503 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.637928:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.637944:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 40 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.637953:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.637987:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 40 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.638008:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 40 pid: 8736 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.638021:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061813888:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620301.638124:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620301.641980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.642027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.642066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.642085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620301.642180:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045036288 00000100:00100000:1.0:1788620301.642188:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045036288 00000100:00100000:1.0:1788620301.642237:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045036416 00000100:00100000:1.0:1788620301.642239:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045036416 00000100:00100000:1.0:1788620301.642295:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:1.0:1788620301.642306:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504045036288:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620301.642378:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504045036288:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 73us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.642403:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:1.0:1788620301.642422:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:1.0:1788620301.642430:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045036416:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620301.642459:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045036416:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620301.642466:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00080000:1.0:1788620301.642482:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620301.643771:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045036160 00000100:00100000:0.0:1788620301.643797:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045036160 00000100:00100000:0.0:1788620301.643851:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 290 00000100:00100000:0.0:1788620301.643872:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045036160:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620301.643932:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045036160:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 73us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620301.643940:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 290 00000100:00100000:0.0:1788620301.644021:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045036544 00000100:00100000:0.0:1788620301.644026:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045036544 00000100:00100000:0.0:1788620301.644061:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 142 00000100:00100000:0.0:1788620301.644067:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504045036544:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620301.644102:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2353:x1875504045036544:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 35us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620301.644108:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 142 00000100:00100000:0.0:1788620301.644163:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061813888:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620301.644186:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620301.652575:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.652718:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045036672 00000100:00100000:3.0:1788620301.652730:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045036672 00010000:00010000:3.0:1788620301.652778:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 41 pid: 8736 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620301.652824:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:3.0:1788620301.652835:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+41:2355:x1875504045036672:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620301.652883:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620301.652892:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 41 pid: 8736 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.652908:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 41 pid: 8736 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.652931:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24f5 expref: 41 pid: 8736 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.652948:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620301.652954:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.652964:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.652971:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620301.653008:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620301.653059:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:2355:x1875504045036672:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 225us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620301.653067:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 64 00010000:00010000:1.0:1788620301.654228:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.654242:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620301.654288:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788620301.654459:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0f48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.654478:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620301.654487:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620301.654490:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788620301.654493:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030c00, rc 0) 00000100:00100000:1.0:1788620301.654552:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:11395:x1875504045036032:12345-192.168.201.11@tcp:101:dd.0 Request processed in 17382us (18017us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788620301.654561:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 154 00000100:00100000:0.0:1788620301.667348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.667961:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045036928 00000100:00100000:2.0:1788620301.667973:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045036928 00000100:00100000:2.0:1788620301.668040:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 155 00000100:00100000:2.0:1788620301.668049:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:11395:x1875504045036928:12345-192.168.201.11@tcp:36:dd.0 00010000:00010000:2.0:1788620301.668355:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.668372:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.668399:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620301.668454:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788620301.668480:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b90e505 reply state 00000000feb03aa7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620301.668489:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620301.668592:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:11395:x1875504045036928:12345-192.168.201.11@tcp:36:dd.0 Request processed in 543us (1253us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788620301.668819:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 155 00000020:00080000:2.0:1788620301.668826:0:8736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788620301.678422:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.678441:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.678450:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.678456:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620301.678478:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.678486:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.678505:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620301.678510:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620301.678515:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.678522:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.925369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620301.925475:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045037056 00000100:00100000:2.0:1788620301.925484:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045037056 00000100:00100000:2.0:1788620301.925599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 156 00000100:00100000:2.0:1788620301.925608:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+42:11410:x1875504045037056:12345-192.168.201.11@tcp:101:stat.0 00010000:00010000:2.0:1788620301.925634:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620301.925650:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0f64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b250a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925700:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925711:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925720:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925746:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925751:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925755:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925830:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925836:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925841:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925869:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.925882:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 43 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620301.925895:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666ff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061814016:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620301.926089:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620301.928428:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666ff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061814016:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620301.928453:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.930684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620301.932768:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045037312 00000100:00100000:3.0:1788620301.932781:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045037312 00000100:00100000:3.0:1788620301.932837:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:3.0:1788620301.932848:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+44:5590:x1875504045037312:12345-192.168.201.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788620301.933205:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:5590:x1875504045037312:12345-192.168.201.11@tcp:35:ldlm_bl.0 Request processed in 357us (2526us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788620301.933217:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:2.0:1788620301.939622:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620301.939826:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045037440 00000100:00100000:0.0:1788620301.939837:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045037440 00010000:00010000:0.0:1788620301.939882:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 45 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620301.940052:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:0.0:1788620301.940063:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:2356:x1875504045037440:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620301.940079:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620301.940086:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 45 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.940121:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 45 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.940146:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0f4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2503 expref: 45 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.940165:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620301.940172:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.940181:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.940188:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620301.940220:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620301.940317:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+44:2356:x1875504045037440:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 255us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620301.940324:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 65 00010000:00010000:2.0:1788620301.940382:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940403:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620301.940460:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788620301.940478:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620301.940512:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940541:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940554:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940562:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940568:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940574:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620301.940579:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940586:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940595:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620301.940597:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620301.940601:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940616:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0f6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940628:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940633:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940638:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940643:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620301.940646:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940653:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940661:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620301.940664:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620301.940666:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940671:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940707:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0f64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b250a expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940721:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b250a expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620301.940733:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620301.940736:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620301.940738:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3a00, rc 0) 00000100:00100000:2.0:1788620301.940776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:11410:x1875504045037056:12345-192.168.201.11@tcp:101:stat.0 Request processed in 15169us (15421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620301.940784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 156 00000100:00100000:2.0:1788620302.017694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620302.017833:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045037696 00000100:00100000:3.0:1788620302.017842:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045037696 00000100:00100000:3.0:1788620302.017913:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 157 00000100:00100000:3.0:1788620302.017924:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:11416:x1875504045037696:12345-192.168.201.11@tcp:36:truncate.0 00010000:00010000:3.0:1788620302.017984:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620302.018016:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3a00/0x24857de440bd0f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b250a expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.018039:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620302.018045:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788620302.018062:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788620302.020558:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.020583:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.020595:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788620302.020696:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788620302.021000:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3c45e16 reply state 000000004b159409 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620302.021010:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620302.021191:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:11416:x1875504045037696:12345-192.168.201.11@tcp:36:truncate.0 Request processed in 3266us (3511us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788620302.021216:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 157 00000020:00080000:3.0:1788620302.021222:0:8736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788620302.025089:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.025108:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.025316:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.025323:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620302.025329:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.025338:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.025357:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620302.025360:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620302.025365:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.025371:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd0f80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620302.169394:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620302.169573:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045037824 00000100:00100000:1.0:1788620302.169584:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045037824 00000100:00100000:1.0:1788620302.169685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 158 00000100:00100000:1.0:1788620302.169694:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+44:11430:x1875504045037824:12345-192.168.201.11@tcp:101:stat.0 00010000:00010000:1.0:1788620302.169715:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620302.169732:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2511 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169796:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169806:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169814:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169823:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169828:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169831:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169933:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169941:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.169967:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620302.170004:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788620302.170009:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620302.170030:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170042:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170049:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170056:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170062:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170068:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620302.170072:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170079:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170092:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620302.170095:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620302.170099:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170113:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd0f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170128:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170134:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170140:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170144:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620302.170148:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170154:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170162:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d64c7c2700) 00010000:00010000:1.0:1788620302.170165:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620302.170167:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170171:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170194:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170202:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 45 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.170212:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620302.170214:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620302.170215:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620302.170297:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:11430:x1875504045037824:12345-192.168.201.11@tcp:101:stat.0 Request processed in 604us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620302.170303:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 158 00000100:00100000:0.0:1788620302.185168:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061814400:0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620302.185334:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788620302.185341:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d675cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061814272:0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620302.185400:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061814784:0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185441:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620302.185492:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061814784 00000100:00100000:0.0:1788620302.185501:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061814784 00000100:00100000:0.0:1788620302.185563:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788620302.185572:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061814784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185625:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061814784:12345-0@lo:400:kworker.0 Request processed in 54us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620302.185632:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788620302.185676:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061814784:0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185701:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061814400 00000100:00100000:0.0:1788620302.185705:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061814400 00000100:00100000:0.0:1788620302.185736:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061814272 00000100:00100000:0.0:1788620302.185739:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061814272 00000100:00100000:0.0:1788620302.185766:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788620302.185774:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061814400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185812:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061814400:12345-0@lo:400:kworker.0 Request processed in 39us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620302.185818:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788620302.185829:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788620302.185835:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061814272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185865:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061814272:12345-0@lo:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620302.185871:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788620302.185887:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620302.185905:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061814272:0@lo:400:kworker.0 00000100:00100000:0.0:1788620302.185914:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d675cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061814400:0@lo:400:kworker.0 00000100:00100000:1.0:1788620302.186201:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061814528:0@lo:400:kworker.0 00000100:00100000:1.0:1788620302.186234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620302.186281:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788620302.186287:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061814144:0@lo:400:kworker.0 00000100:00100000:1.0:1788620302.186314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620302.186338:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061814656:0@lo:400:kworker.0 00000100:00100000:1.0:1788620302.186374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620302.186405:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061814528 00000100:00100000:1.0:1788620302.186421:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061814528 00000100:00100000:1.0:1788620302.186461:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788620302.186468:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061814528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620302.186505:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061814528:12345-0@lo:400:kworker.0 Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620302.186512:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788620302.186541:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620302.186559:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061814528:0@lo:400:kworker.0 00000100:00100000:1.0:1788620302.186576:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061814656 00000100:00100000:1.0:1788620302.186579:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061814656 00000100:00080000:1.0:1788620302.186603:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620302.186626:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788620302.186632:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061814656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620302.186669:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061814656:12345-0@lo:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620302.186675:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788620302.186699:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061814656:0@lo:400:kworker.0 00000100:00100000:2.0:1788620302.187533:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061814144 00000100:00100000:2.0:1788620302.187542:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061814144 00000100:00100000:2.0:1788620302.187595:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788620302.187604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061814144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620302.187667:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061814144:12345-0@lo:400:kworker.0 Request processed in 64us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620302.187673:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788620302.187781:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061814144:0@lo:400:kworker.0 00000004:00080000:0.0:1788620302.188602:0:7778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352227350596ns, next at 353227348056ns, rc = 0 00000100:00100000:3.0:1788620302.188688:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620302.188701:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061814912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620302.188745:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620302.188887:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061814912 00000100:00100000:0.0:1788620302.188895:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061814912 00000100:00100000:0.0:1788620302.188945:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788620302.188956:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061814912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620302.188979:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620302.189032:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061814912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620302.189040:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788620302.189079:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061814912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620302.245929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620302.246165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045038080 00000100:00100000:1.0:1788620302.246180:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045038080 00000100:00100000:1.0:1788620302.246289:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 159 00000100:00100000:1.0:1788620302.246303:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+45:11440:x1875504045038080:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620302.246329:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620302.246363:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2518 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620302.246542:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788620302.246695:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0fa3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2518 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.246711:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:1.0:1788620302.246714:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788620302.246720:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd0fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2518 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.246735:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620302.246804:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:11440:x1875504045038080:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 504us (887us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788620302.246828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 159 00000100:00100000:0.0:1788620302.250216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620302.250589:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045038336 00000100:00100000:3.0:1788620302.250599:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045038336 00000100:00100000:3.0:1788620302.250654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:3.0:1788620302.250663:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+46:11440:x1875504045038336:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:3.0:1788620302.250972:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:11440:x1875504045038336:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 309us (767us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788620302.250980:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:3.0:1788620302.316193:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.317299:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045038592 00000100:00100000:2.0:1788620302.317313:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045038592 00000100:00100000:2.0:1788620302.317497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 160 00000100:00100000:2.0:1788620302.317507:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+47:11446:x1875504045038592:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:2.0:1788620302.317548:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620302.317570:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b251f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.317666:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.317677:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.317684:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.317711:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.317735:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 48 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620302.317746:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666ff4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061815040:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620302.317850:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620302.327785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620302.327862:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045038720 00000100:00100000:3.0:1788620302.327873:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045038720 00010000:00010000:3.0:1788620302.327922:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 49 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620302.327958:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 66 00000100:00100000:3.0:1788620302.327968:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:2355:x1875504045038720:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620302.327980:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620302.327986:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 49 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.328008:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 49 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.328034:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620302.328038:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.328046:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.328050:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.328072:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620302.328126:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+49:2355:x1875504045038720:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 160us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620302.328131:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 66 00010000:00010000:2.0:1788620302.328854:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd0f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2511 expref: 48 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620302.328981:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666ff4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061815040:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620302.329006:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.329015:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.329021:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620302.329041:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788620302.329207:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.329223:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.329232:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620302.329244:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788620302.329340:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3e00, rc 0) 00000100:00100000:2.0:1788620302.329506:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+48:11446:x1875504045038592:12345-192.168.201.11@tcp:101:bash.0 Request processed in 12000us (13319us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788620302.329514:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 160 00000100:00100000:1.0:1788620302.334840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620302.334921:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045038976 00000100:00100000:0.0:1788620302.334931:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045038976 00000100:00100000:0.0:1788620302.334981:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 161 00000100:00100000:0.0:1788620302.334988:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+48:11446:x1875504045038976:12345-192.168.201.11@tcp:36:bash.0 00010000:00010000:0.0:1788620302.335235:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.335782:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.335797:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620302.335857:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788620302.335885:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9a0419e reply state 000000002acb0852 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620302.335894:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620302.336043:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:11446:x1875504045038976:12345-192.168.201.11@tcp:36:bash.0 Request processed in 1053us (1211us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788620302.336067:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 161 00000020:00080000:0.0:1788620302.336072:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620302.342828:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.342847:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.342854:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.342870:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620302.342875:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.342904:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.342922:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620302.342925:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620302.342931:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.342937:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd0fc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620302.343674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620302.343799:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045039104 00000100:00100000:0.0:1788620302.343811:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045039104 00000100:00100000:0.0:1788620302.343880:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 162 00000100:00100000:0.0:1788620302.343892:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:11446:x1875504045039104:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620302.343920:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620302.343938:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0fcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2526 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.344023:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.344038:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.344047:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.344082:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.344096:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 51 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620302.344110:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061815168:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620302.344198:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119780 going to sleep for 11 seconds 00000100:00100000:2.0:1788620302.348322:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f80f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061815168:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620302.348358:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620302.349825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.350070:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045039232 00000100:00100000:2.0:1788620302.350080:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045039232 00010000:00010000:2.0:1788620302.350120:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 52 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620302.350162:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 67 00000100:00100000:2.0:1788620302.350171:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:2355:x1875504045039232:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620302.350186:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620302.350194:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 52 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.350206:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 52 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.350229:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b251f expref: 52 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.350244:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620302.350495:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.350506:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.350514:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.350593:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620302.350647:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:2355:x1875504045039232:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 477us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620302.350655:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 67 00010000:00010000:3.0:1788620302.354151:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.354165:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620302.354218:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788620302.354223:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620302.354245:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.354436:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd0fcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2526 expref: 51 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.354457:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2526 expref: 50 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.354464:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620302.354466:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620302.354483:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031c00, rc 0) 00000100:00100000:3.0:1788620302.354684:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:11446:x1875504045039104:12345-192.168.201.11@tcp:101:bash.0 Request processed in 10793us (11014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620302.354701:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 162 00000100:00100000:1.0:1788620302.358984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620302.359117:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045039488 00000100:00100000:0.0:1788620302.359127:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045039488 00000100:00100000:0.0:1788620302.359181:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:0.0:1788620302.359190:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:11446:x1875504045039488:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:0.0:1788620302.359546:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:11446:x1875504045039488:12345-192.168.201.11@tcp:35:bash.0 Request processed in 355us (573us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788620302.359554:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:0.0:1788620302.431444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.432053:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045039744 00000100:00100000:2.0:1788620302.432064:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045039744 00000100:00100000:2.0:1788620302.432175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 163 00000100:00100000:2.0:1788620302.432186:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:11456:x1875504045039744:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620302.432209:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620302.432229:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b252d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620302.432559:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788620302.432659:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fdb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b252d expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.432670:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:2.0:1788620302.432673:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620302.432676:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd0fdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b252d expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.433082:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3e00, rc 0) 00000100:00100000:2.0:1788620302.433176:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f80f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11456:x1875504045039744:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 992us (1741us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788620302.433182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 163 00000100:00100000:1.0:1788620302.437009:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.437059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045039872 00000100:00100000:2.0:1788620302.437071:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045039872 00000100:00100000:2.0:1788620302.437133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 164 00000100:00100000:2.0:1788620302.437145:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11456:x1875504045039872:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:2.0:1788620302.437233:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437285:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437298:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437315:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437323:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437329:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437438:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437465:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437473:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620302.437531:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437544:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437550:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437557:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437563:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620302.437567:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437574:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437587:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620302.437590:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620302.437595:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437600:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd0fe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437619:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437625:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437631:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437636:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620302.437639:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437645:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437653:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620302.437655:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620302.437658:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437664:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd0ff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437678:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437685:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437691:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437703:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620302.437706:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437712:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437720:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620302.437723:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620302.437726:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.437731:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd0ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620302.437808:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11456:x1875504045039872:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 664us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620302.437816:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 164 00000100:00100000:1.0:1788620302.439573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620302.439630:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045040128 00000100:00100000:0.0:1788620302.439638:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045040128 00000100:00100000:0.0:1788620302.439675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:0.0:1788620302.439682:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11456:x1875504045040128:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620302.439886:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:11456:x1875504045040128:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 202us (316us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788620302.439893:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:0.0:1788620302.471405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620302.471569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045040384 00000100:00100000:1.0:1788620302.471580:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045040384 00000100:00100000:1.0:1788620302.471690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 165 00000100:00100000:1.0:1788620302.471701:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+53:11459:x1875504045040384:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620302.471726:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620302.471745:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2534 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.471816:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.471830:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.471842:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.471856:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.471864:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.471882:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.471996:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472005:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472013:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620302.472023:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788620302.472110:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472118:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472126:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472133:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620302.472138:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472146:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472157:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620302.472160:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620302.472170:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472178:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472206:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472213:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472220:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472226:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620302.472229:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472236:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472244:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d64c7c2700) 00010000:00010000:1.0:1788620302.472246:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620302.472289:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472297:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd100c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472336:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd0ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2534 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472362:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2534 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.472370:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620302.472372:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620302.472375:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548400, rc 0) 00000100:00100000:1.0:1788620302.472431:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11459:x1875504045040384:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 732us (1032us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788620302.472439:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 165 00000100:00100000:2.0:1788620302.474756:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620302.475014:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045040512 00000100:00100000:3.0:1788620302.475023:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045040512 00000100:00100000:3.0:1788620302.475072:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 166 00000100:00100000:3.0:1788620302.475083:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11459:x1875504045040512:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:3.0:1788620302.475148:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475167:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475178:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475206:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475213:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475219:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475224:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620302.475228:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475234:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475295:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620302.475298:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620302.475310:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620302.475318:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620302.475389:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11459:x1875504045040512:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 307us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620302.475397:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 166 00000100:00100000:3.0:1788620302.477550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620302.477593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620302.477669:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045040768 00000100:00100000:0.0:1788620302.477678:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045040768 00000100:00100000:0.0:1788620302.477730:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:0.0:1788620302.477741:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11459:x1875504045040768:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620302.477953:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:11459:x1875504045040768:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 214us (411us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788620302.477962:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:1.0:1788620302.478030:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045040896 00000100:00100000:1.0:1788620302.478034:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045040896 00000100:00100000:1.0:1788620302.478074:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:1.0:1788620302.478081:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:2355:x1875504045040896:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620302.478093:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620302.478113:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2534 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620302.478131:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620302.478136:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620302.478168:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:2355:x1875504045040896:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 84us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620302.478176:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:3.0:1788620302.548848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.548926:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045041152 00000100:00100000:2.0:1788620302.548936:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045041152 00000100:00100000:2.0:1788620302.548992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 167 00000100:00100000:2.0:1788620302.549002:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6436aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11477:x1875504045041152:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:2.0:1788620302.549031:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620302.549063:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd1028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b253b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.549163:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd102f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.549191:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd102f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.549203:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd102f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620302.549216:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788620302.549368:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd1028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b253b expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.549383:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd102f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b253b expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.549390:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620302.549392:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788620302.549394:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2c00, rc 0) 00000100:00100000:2.0:1788620302.549450:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6436aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11477:x1875504045041152:12345-192.168.201.11@tcp:101:cat.0 Request processed in 451us (613us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788620302.549455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 167 00000100:00100000:3.0:1788620302.562465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.562598:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045041280 00000100:00100000:2.0:1788620302.562606:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045041280 00000100:00100000:2.0:1788620302.562665:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 168 00000100:00100000:2.0:1788620302.562674:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11478:x1875504045041280:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620302.562700:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620302.562719:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd103d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2542 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.563102:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1044 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.563117:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.563130:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620302.563243:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788620302.563247:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620302.563301:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.563328:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd103d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2542 expref: 59 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.563345:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2542 expref: 58 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.563355:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620302.563358:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620302.563361:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3e00, rc 0) 00000100:00100000:2.0:1788620302.563470:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11478:x1875504045041280:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 795us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620302.563478:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 168 00000100:00100000:3.0:1788620302.566708:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.566845:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045041664 00000100:00100000:2.0:1788620302.566855:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045041664 00000100:00100000:2.0:1788620302.567179:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:2.0:1788620302.567189:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11478:x1875504045041664:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620302.567906:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11478:x1875504045041664:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 716us (1206us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788620302.567915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:3.0:1788620302.569788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.569823:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045041792 00000100:00100000:2.0:1788620302.569832:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045041792 00000100:00100000:2.0:1788620302.569889:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:2.0:1788620302.569900:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11478:x1875504045041792:12345-192.168.201.11@tcp:103:lfs.0 00010000:00010000:2.0:1788620302.569916:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788620302.569937:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd0fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2526 expref: 59 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.569954:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd102f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b253b expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.569963:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd0edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24e7 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.569972:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620302.569980:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620302.570019:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:11478:x1875504045041792:12345-192.168.201.11@tcp:103:lfs.0 Request processed in 122us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620302.570025:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:1.0:1788620302.571843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620302.571885:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045041920 00000100:00100000:2.0:1788620302.571894:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045041920 00000100:00100000:2.0:1788620302.571939:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 169 00000100:00100000:2.0:1788620302.571958:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:11478:x1875504045041920:12345-192.168.201.11@tcp:58:lfs.0 00010000:00010000:2.0:1788620302.572047:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.572060:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620302.572068:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620302.572230:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788620302.572331:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:11478:x1875504045041920:12345-192.168.201.11@tcp:58:lfs.0 Request processed in 373us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620302.572337:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 169 00000100:00100000:1.0:1788620302.585017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620302.585110:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045042048 00000100:00100000:0.0:1788620302.585122:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045042048 00000100:00100000:0.0:1788620302.585177:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 170 00000100:00100000:0.0:1788620302.585196:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:11480:x1875504045042048:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620302.585214:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620302.585233:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd1052 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2549 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585320:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585332:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585340:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585350:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585354:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585358:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585430:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585437:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585443:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620302.585486:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788620302.585490:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620302.585508:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585532:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585541:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585546:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585553:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585558:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620302.585562:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585569:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585580:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:0.0:1788620302.585583:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620302.585588:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585595:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585616:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585620:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585623:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585626:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620302.585628:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585631:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585636:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d642f43300) 00010000:00010000:0.0:1788620302.585637:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620302.585639:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585642:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585664:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd1052 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585673:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620302.585684:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:0.0:1788620302.585685:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620302.585687:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030e00, rc 0) 00000100:00100000:0.0:1788620302.585737:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11480:x1875504045042048:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 541us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620302.585744:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 170 00010000:00010000:0.0:1788620302.632530:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620302.696462:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620302.696504:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061815296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620302.696575:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620302.696614:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061815296 00000100:00100000:2.0:1788620302.696624:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061815296 00000100:00100000:2.0:1788620302.696702:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788620302.696712:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061815296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620302.696746:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620302.696799:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061815296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620302.696807:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788620302.696946:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061815296:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788620303.408975:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620303.408983:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620303.409170:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788620303.409177:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788620303.411584:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e29c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061815424:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788620303.416954:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d658353540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620303.417227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.418882:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e29c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061815424:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788620303.419215:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045042176 00000100:00100000:0.0:1788620303.419222:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045042176 00000100:00100000:0.0:1788620303.419301:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 171 00000100:00100000:0.0:1788620303.419311:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11491:x1875504045042176:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788620303.419340:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788620303.419455:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11491:x1875504045042176:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 144us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620303.419464:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 171 00000100:00100000:2.0:1788620303.429362:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620303.429401:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045042304 00000100:00100000:2.0:1788620303.429411:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045042304 00000100:00100000:2.0:1788620303.429467:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 172 00000100:00100000:2.0:1788620303.429478:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11491:x1875504045042304:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788620303.429577:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429602:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429618:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429637:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429655:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429662:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429690:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429698:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429705:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620303.429742:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788620303.429746:0:8736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620303.429759:0:8736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429770:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429788:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429795:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429801:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620303.429806:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429814:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429827:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:2.0:1788620303.429831:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620303.429836:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429841:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd106e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429854:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429861:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429867:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429873:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620303.429882:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429889:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429898:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffffa0d647f7c100) 00010000:00010000:2.0:1788620303.429901:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620303.429905:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429911:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1075 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429927:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429934:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429940:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429945:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620303.429949:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429955:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429964:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620303.429967:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620303.429976:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.429983:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd107c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620303.430059:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11491:x1875504045042304:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 Request processed in 582us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620303.430068:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 172 00000100:00100000:1.0:1788620303.439291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.439368:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045042560 00000100:00100000:3.0:1788620303.439377:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045042560 00000100:00100000:3.0:1788620303.439440:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 173 00000100:00100000:3.0:1788620303.439461:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11491:x1875504045042560:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620303.439483:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620303.439514:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1083 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2550 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439628:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439643:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439654:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620303.439666:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788620303.439760:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439769:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439776:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439782:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620303.439786:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439793:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439806:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:3.0:1788620303.439815:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620303.439820:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439828:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd108a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439870:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1083 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2550 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439880:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:3.0:1788620303.439882:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620303.439887:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1083 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2550 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.439896:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643c00, rc 0) 00000100:00100000:3.0:1788620303.439950:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11491:x1875504045042560:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 491us (668us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788620303.439957:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 173 00000100:00100000:1.0:1788620303.446556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.446828:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045042688 00000100:00100000:3.0:1788620303.446840:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045042688 00000100:00100000:3.0:1788620303.454162:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 174 00000100:00100000:3.0:1788620303.454181:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11491:x1875504045042688:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788620303.454218:0:8736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788620303.454549:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11491:x1875504045042688:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 373us (8001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620303.454558:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 174 00000100:00100000:3.0:1788620303.458999:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620303.459124:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045042944 00000100:00100000:1.0:1788620303.459135:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045042944 00000100:00100000:1.0:1788620303.459203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 175 00000100:00100000:1.0:1788620303.459214:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11491:x1875504045042944:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620303.459235:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620303.459238:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788620303.459286:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1044 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2542 expref: 58 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.459304:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620303.459309:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788620303.459322:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1098 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2557 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788620303.459725:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788620303.459921:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd109f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.459934:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd109f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.459944:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd109f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.460004:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1098 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2557 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.461135:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd109f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2557 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.461143:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d64c7c2700) 00010000:00010000:1.0:1788620303.461146:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620303.461148:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620303.461312:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11491:x1875504045042944:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 2098us (2355us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788620303.461321:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 175 00000100:00100000:0.0:1788620303.469532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620303.469560:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045043200 00000100:00100000:2.0:1788620303.469571:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045043200 00000100:00100000:2.0:1788620303.469626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 176 00000100:00100000:2.0:1788620303.469636:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11491:x1875504045043200:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788620303.469704:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620303.469731:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd109f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2557 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469749:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d64c7c2700) 00010000:00010000:2.0:1788620303.469759:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620303.469781:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469794:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469804:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469823:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469830:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469836:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469906:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469913:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469920:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469926:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620303.469931:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469938:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469946:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620303.469949:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620303.469952:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469957:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd10ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469972:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469978:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469983:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469988:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620303.469991:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.469997:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.470019:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfcb8dd3a (ffffa0d647f7c100) 00010000:00010000:2.0:1788620303.470022:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620303.470025:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.470030:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd10b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfcb8dd3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620303.470115:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11491:x1875504045043200:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 479us (593us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788620303.470122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 176 00000100:00100000:2.0:1788620303.474076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.474203:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045043328 00000100:00100000:3.0:1788620303.474214:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045043328 00000100:00100000:3.0:1788620303.474305:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 177 00000100:00100000:3.0:1788620303.474316:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11491:x1875504045043328:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620303.474349:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620303.474372:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b255e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.474408:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.474421:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.474433:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.474652:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.474683:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.474693:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620303.474696:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788620303.474699:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643600, rc 0) 00000100:00100000:3.0:1788620303.474761:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11491:x1875504045043328:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 447us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620303.474769:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 177 00000100:00100000:0.0:1788620303.480374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620303.480550:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045043584 00000100:00100000:1.0:1788620303.480560:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045043584 00000100:00100000:1.0:1788620303.480620:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 178 00000100:00100000:1.0:1788620303.480629:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67f816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11491:x1875504045043584:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788620303.480866:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.480884:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.480895:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788620303.481159:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788620303.481167:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353519917124ns, next at 354519915390ns, rc = 0 00000004:00010000:1.0:1788620303.481317:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc28c5c2 reply state 00000000246f4dba transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620303.481327:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788620303.481454:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67f816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11491:x1875504045043584:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 824us (1088us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788620303.481471:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 178 00000100:00100000:2.0:1788620303.498200:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00010000:00010000:3.0:1788620303.499466:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499481:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499497:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499515:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620303.499520:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499529:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499547:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620303.499550:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788620303.499555:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499561:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd10c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.499597:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045043712 00000100:00100000:3.0:1788620303.499608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045043712 00000100:00100000:3.0:1788620303.499773:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 179 00000100:00100000:3.0:1788620303.499786:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11491:x1875504045043712:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620303.499816:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620303.499833:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2565 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499891:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499915:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.499935:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620303.499938:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620303.499940:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643c00, rc 0) 00000100:00100000:3.0:1788620303.500003:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11491:x1875504045043712:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 219us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620303.505414:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 179 00000100:00100000:1.0:1788620303.520622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.521098:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045043840 00000100:00100000:3.0:1788620303.521109:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045043840 00000100:00100000:3.0:1788620303.521182:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:3.0:1788620303.521194:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045043840:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788620303.521372:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620303.521698:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045043840:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 505us (1084us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788620303.521707:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:3.0:1788620303.529826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.529860:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045044096 00000100:00100000:3.0:1788620303.529869:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045044096 00000100:00100000:3.0:1788620303.529920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:3.0:1788620303.529931:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11491:x1875504045044096:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788620303.530155:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11491:x1875504045044096:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 225us (339us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788620303.530164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:3.0:1788620303.536582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000040:00080000:0.0:1788620303.539552:0:12401:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788620303.539561:0:12401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620303.539592:0:12401:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788620303.539597:0:12401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788620303.543573:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045044352 00000100:00100000:1.0:1788620303.543585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045044352 00000100:00100000:1.0:1788620303.545529:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 180 00000100:00100000:1.0:1788620303.545554:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11491:x1875504045044352:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788620303.545698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11491:x1875504045044352:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 155us (9129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620303.545706:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 180 00000100:00100000:1.0:1788620303.574359:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620303.574520:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045044480 00000100:00100000:0.0:1788620303.574531:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045044480 00000100:00100000:0.0:1788620303.574589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 181 00000100:00100000:0.0:1788620303.574600:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11491:x1875504045044480:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620303.574636:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620303.574654:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd10d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b256c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.574746:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd10de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.574760:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd10de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.574771:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd10de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620303.574805:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620303.574823:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd10de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.574848:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd10d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b256c expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.574864:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd10de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b256c expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.574872:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:0.0:1788620303.574875:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788620303.574878:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031c00, rc 0) 00000100:00100000:0.0:1788620303.574932:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+63:11491:x1875504045044480:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 334us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620303.574941:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 181 00000100:00100000:3.0:1788620303.581039:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620303.581160:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045044608 00000100:00100000:1.0:1788620303.581172:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045044608 00000100:00100000:1.0:1788620303.581238:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:1.0:1788620303.581290:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045044608:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620303.581312:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620303.581336:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2573 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620303.581364:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2e0f, blocks: 0x1 00010000:00010000:1.0:1788620303.581384:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788620303.581402:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620303.581413:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.581437:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.581451:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548600, rc 0) 00000100:00100000:1.0:1788620303.581519:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2353:x1875504045044608:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 272us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620303.581527:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:1.0:1788620303.594495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.595113:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045044864 00000100:00100000:3.0:1788620303.595125:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045044864 00000100:00100000:3.0:1788620303.595194:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 182 00000100:00100000:3.0:1788620303.595205:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+63:11491:x1875504045044864:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788620303.595940:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+63:11491:x1875504045044864:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 734us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620303.595951:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 182 00000100:00100000:1.0:1788620303.608923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.609001:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045044992 00000100:00100000:3.0:1788620303.609011:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045044992 00000100:00100000:3.0:1788620303.609065:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:3.0:1788620303.609083:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:11491:x1875504045044992:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620303.609100:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620303.609117:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b257a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.609148:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.609158:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620303.609162:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620303.609168:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.609425:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.609458:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 9 pid: 6689 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.609474:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875504061815552:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620303.609612:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d658353540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620303.621792:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875504061815552:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620303.621831:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.621850:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642000, rc 0) 00000100:00100000:1.0:1788620303.621906:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:11491:x1875504045044992:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 12834us (12998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620303.621914:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:1.0:1788620303.627078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.627161:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045045120 00000100:00100000:3.0:1788620303.627172:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045045120 00010000:00010000:3.0:1788620303.627402:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 9 pid: 6689 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.627465:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:3.0:1788620303.627477:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504045045120:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620303.627494:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620303.627527:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 9 pid: 6689 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.627542:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 9 pid: 6689 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.627565:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d993e8f4/0x24857de440bd10e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2573 expref: 9 pid: 6689 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.627592:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620303.627608:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620303.627616:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.627627:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.627664:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.628157:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875504061815680:192.168.201.11@tcp:105: 00000100:00100000:3.0:1788620303.628488:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d658353540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620303.635716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620303.637822:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045045248 00000100:00100000:0.0:1788620303.637838:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045045248 00002000:00100000:0.0:1788620303.637897:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0d68084dc00 x1875504045045248/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:399/0 lens 504/0 e 0 to 0 dl 1788620314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788620303.637908:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d68084dc00 with x1875504045045248 ext(0->8) 00002000:00010000:0.0:1788620303.637913:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d68084dc00 00000100:00100000:0.0:1788620303.637952:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:1.0:1788620303.637960:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788620303.637965:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504045045248:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788620303.637970:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788620303.639574:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875504061815680:192.168.201.11@tcp:105: 00010000:00010000:3.0:1788620303.639602:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620303.640757:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:2356:x1875504045045120:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 13277us (13681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620303.640770:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:0.0:1788620303.642391:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:2356:x1875504045045248:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 Request processed in 4421us (6673us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788620303.642404:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00002000:00100000:0.0:1788620303.642417:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0d68084dc00 x1875504045045248/t4294967314(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:399/0 lens 504/448 e 0 to 0 dl 1788620314 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788620303.642428:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d68084dc00 with x1875504045045248 ext(0->8) 00002000:00010000:0.0:1788620303.642433:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d68084dc00 00010000:00010000:3.0:1788620303.659717:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620303.661767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620303.661837:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045045376 00000100:00100000:2.0:1788620303.661861:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045045376 00000100:00100000:2.0:1788620303.661919:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 183 00000100:00100000:2.0:1788620303.661929:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6809f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+63:11491:x1875504045045376:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788620303.734901:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6809f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+63:11491:x1875504045045376:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 Request processed in 72965us (73135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620303.734915:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 183 00000001:00080000:2.0:1788620303.739595:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:2.0:1788620303.739622:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788620303.739644:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788620303.739653:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d67a119540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788620303.739657:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d644c30800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d67a119a80 00000020:00080000:2.0:1788620303.739660:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d644c30100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d675c6c000 00000001:00080000:2.0:1788620303.739677:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788620303.739680:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:2.0:1788620303.739744:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:1.0:1788620303.739949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620303.740361:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045045504 00000100:00100000:2.0:1788620303.740372:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045045504 00000100:00100000:2.0:1788620303.740427:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:2.0:1788620303.740437:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:2356:x1875504045045504:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 00000020:00080000:0.0:1788620303.740720:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1788620303.740787:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061815808:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788620303.740840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788620303.740967:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788620303.744404:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061815808 00000100:00100000:2.0:1788620303.744415:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061815808 00000100:00100000:2.0:1788620303.744472:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788620303.744480:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061815936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788620303.744482:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875504061815808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788620303.744518:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788620303.744552:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c2e0c, atime: 0x6a9c2e0c, ctime: 0x6a9c2e0c, blocks: 0x1 00010000:00010000:2.0:1788620303.744560:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620303.744560:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788620303.744577:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1788620303.744587:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620303.744594:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788620303.744601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788620303.744611:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.744621:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.744628:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.744709:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620303.744914:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620303.744921:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.744929:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620303.744938:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.744948:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.744963:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.744970:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f6abcb7/0x24857de440bd10f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.744986:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620303.744987:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620303.744989:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620303.745173:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875504061815808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 692us (4332us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788620303.745181:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788620303.745198:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061815936 00000100:00100000:2.0:1788620303.745202:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061815936 00000100:00100000:2.0:1788620303.745223:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788620303.745229:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061815936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788620303.745523:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788620303.745527:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788620303 00002000:00010000:2.0:1788620303.745530:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788620303.745532:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788620303 -> 1788620303 00002000:00010000:2.0:1788620303.745534:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788620303.745567:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875504061815936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 338us (1007us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788620303.745579:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1788620303.746909:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d67f815500/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788620303.746920:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061815808:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788620303.746983:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d680399c00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788620303.746988:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061815936:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788620303.819598:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1788620303.820485:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045045504:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 Request processed in 80042us (80534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620303.820508:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:3.0:1788620303.825587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620303.826483:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045045760 00000100:00100000:0.0:1788620303.826506:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045045760 00000100:00100000:0.0:1788620303.826657:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 184 00000100:00100000:0.0:1788620303.826669:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11491:x1875504045045760:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620303.826722:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620303.826749:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd10de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b256c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.826766:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:0.0:1788620303.826771:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620303.826801:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.826828:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.826838:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620303.827089:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8cb17fe reply state 0000000001e47689 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620303.827098:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620303.827418:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:11491:x1875504045045760:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 529us (1620us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788620303.827427:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 184 00000100:00100000:1.0:1788620303.847347:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620303.847381:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045045888 00000100:00100000:1.0:1788620303.847391:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045045888 00000100:00100000:1.0:1788620303.847445:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 56 00000100:00100000:1.0:1788620303.847456:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045045888:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788620303.847670:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788620303.847674:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788620303 -> 1788620301 00002000:00010000:1.0:1788620303.847677:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788620300 00002000:00010000:1.0:1788620303.847679:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788620303 -> 1788620301 00002000:00010000:1.0:1788620303.847681:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788620303.847734:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504045045888:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 280us (396us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788620303.847742:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 56 00010000:00010000:3.0:1788620303.848652:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.848666:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.848674:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.848711:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620303.848729:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.848737:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.848786:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620303.848801:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620303.848806:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.848813:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd10fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620303.853574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.853790:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045046144 00000100:00100000:3.0:1788620303.853802:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045046144 00000100:00100000:3.0:1788620303.853865:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 185 00000100:00100000:3.0:1788620303.853876:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11491:x1875504045046144:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788620303.853954:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.853972:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.853980:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.854019:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.854044:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 18 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.854058:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d68039b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061816064:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620303.854147:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620303.864024:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d68039b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061816064:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620303.864061:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.872793:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.872835:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045046272 00000100:00100000:3.0:1788620303.872844:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045046272 00010000:00010000:3.0:1788620303.873166:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.873210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:3.0:1788620303.873220:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:2355:x1875504045046272:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620303.873234:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620303.873241:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873513:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873536:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd10c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b255e expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873552:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620303.873557:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873576:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873583:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873609:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620303.873660:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:2355:x1875504045046272:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 441us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620303.873668:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 69 00010000:00010000:3.0:1788620303.873726:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873734:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873761:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873768:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873775:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873781:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620303.873785:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873793:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873808:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620303.873810:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788620303.873814:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.873820:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1101 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.873860:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:11491:x1875504045046144:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 Request processed in 19986us (20297us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788620303.873868:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 185 00000100:00100000:3.0:1788620303.876780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.876830:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045046400 00000100:00100000:3.0:1788620303.876838:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045046400 00000100:00100000:3.0:1788620303.876886:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 57 00000100:00100000:3.0:1788620303.876895:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2354:x1875504045046400:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788620303.876935:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.876954:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.876962:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620303.876966:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788620303.876971:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.877019:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.877033:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 8 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.877048:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680398000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875504061816192:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620303.877117:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620303.894452:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620303.894959:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680398000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875504061816192:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620303.894992:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620303.895076:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045046528 00000100:00100000:0.0:1788620303.895085:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045046528 00010000:00010000:0.0:1788620303.895126:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 9 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620303.895203:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:0.0:1788620303.895213:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2355:x1875504045046528:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620303.895230:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620303.895302:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 9 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.895328:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 9 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.895352:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec0d10a/0x24857de440bd10ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b257a expref: 9 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.895367:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620303.895372:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620303.895377:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.895387:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.895413:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620303.895478:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504045046528:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 265us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620303.895486:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 70 00010000:00010000:1.0:1788620303.895609:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895619:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895645:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895654:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895663:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895679:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620303.895683:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895692:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895704:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.895723:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b95471b/0x24857de440bd1108 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620303.895773:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045046400:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 Request processed in 18878us (19002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620303.895781:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 57 00000100:00100000:2.0:1788620303.902222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620303.902891:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045046784 00000100:00100000:0.0:1788620303.902903:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045046784 00000100:00100000:0.0:1788620303.903016:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 186 00000100:00100000:0.0:1788620303.903027:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+17:11491:x1875504045046784:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788620303.903115:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.903134:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.903161:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.912062:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.912089:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.912098:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.912140:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.912156:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 18 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620303.912171:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061816320:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620303.912293:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620303.918850:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061816320:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620303.918882:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620303.919358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.919484:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045046912 00000100:00100000:3.0:1788620303.919500:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045046912 00010000:00010000:3.0:1788620303.919544:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620303.919585:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 71 00000100:00100000:3.0:1788620303.919595:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:2356:x1875504045046912:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620303.919611:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620303.919618:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.919632:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.919654:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd10d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2565 expref: 19 pid: 5840 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.919700:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:3.0:1788620303.919705:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.919714:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.919722:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.919746:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620303.919810:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:2356:x1875504045046912:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 216us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620303.919818:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 71 00010000:00010000:0.0:1788620303.920058:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.920067:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620303.920433:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788620303.920604:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788620303.920652:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788620303.927031:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680399500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8736:1875504061816448:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788620303.927114:0:8736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620303.927161:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6431a86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620303.927296:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061816448 00000100:00100000:2.0:1788620303.927303:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061816448 00000100:00100000:2.0:1788620303.927355:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788620303.927364:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8736:x1875504061816448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788620303.927453:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8736:x1875504061816448:12345-0@lo:1000:mdt00_003.0 Request processed in 90us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620303.927461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788620303.928049:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680399500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8736:1875504061816448:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788620303.928627:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788620303.928935:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8736:1875504061816576:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788620303.929009:0:8736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620303.929035:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620303.929587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061816576 00000100:00100000:3.0:1788620303.929596:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061816576 00000100:00100000:3.0:1788620303.929638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788620303.929648:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8736:x1875504061816576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788620303.929882:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8736:x1875504061816576:12345-0@lo:1000:mdt00_003.0 Request processed in 234us (871us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788620303.929890:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788620303.930427:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67f817800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8736:1875504061816576:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788620303.932875:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.932892:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.932899:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.932905:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620303.932909:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.932917:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.932933:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309e200) 00010000:00010000:0.0:1788620303.932936:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620303.932941:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.932965:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd1116 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933004:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933011:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933017:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933022:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620303.933025:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933031:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933040:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:0.0:1788620303.933042:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620303.933045:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933051:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd104b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933072:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933086:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933101:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933144:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620303.933159:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 21 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620303.933174:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061816704:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620303.935864:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a1193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620303.938569:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620303.938714:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045047040 00000100:00100000:1.0:1788620303.938724:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045047040 00010000:00010000:1.0:1788620303.938765:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 22 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620303.938804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 72 00000100:00100000:1.0:1788620303.938813:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:2355:x1875504045047040:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620303.938828:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620303.938836:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 22 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.938849:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 22 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.938872:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:1.0:1788620303.938878:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.938887:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.938914:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.938935:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620303.939004:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:2355:x1875504045047040:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 190us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620303.939011:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 72 00010000:00010000:2.0:1788620303.942621:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd1067 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2549 expref: 21 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620303.942648:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061816704:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620303.942737:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942749:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942754:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942769:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942801:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942810:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942816:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620303.942821:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942829:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942845:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620303.942848:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620303.942853:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942859:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd111d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942871:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942877:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942882:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942887:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620303.942897:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942903:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942911:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620303.942914:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788620303.942917:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620303.942923:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd110f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620303.943269:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:11491:x1875504045046784:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 40220us (41037us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788620303.943293:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 186 00000020:00080000:2.0:1788620303.943299:0:8736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788620303.948787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620303.948853:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045047296 00000100:00100000:3.0:1788620303.948862:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045047296 00000040:00080000:2.0:1788620303.949081:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788620303.949086:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788620303.949409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:3.0:1788620303.949420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:11491:x1875504045047296:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788620303.950043:0:5842:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788620303.950144:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788620303.950191:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.950208:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.950221:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.950231:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.950237:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620303.950244:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620303.950939:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788620303.950954:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788620303.951114:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788620303.951230:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:11491:x1875504045047296:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 1808us (2446us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788620303.951240:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 50 00000020:00080000:3.0:1788620303.951246:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788620303.955500:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620303.955515:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.955527:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643c00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620303.955531:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.955539:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.955559:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0d65309ed00) 00010000:00010000:1.0:1788620303.955562:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788620303.955566:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.955572:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620303.955601:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620303.955603:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620303.955605:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620304.680472:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788620304.792345:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788620304.792377:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788620304.792384:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:0.0:1788620305.557545:0:12454:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788620305.557553:0:12454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620305.557590:0:12454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788620305.557596:0:12454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788620305.667941:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620305.668038:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045047552 00000100:00100000:1.0:1788620305.668118:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045047552 00000100:00100000:1.0:1788620305.668203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 187 00000100:00100000:1.0:1788620305.668213:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:11509:x1875504045047552:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620305.668237:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620305.668332:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd112b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2581 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788620305.668744:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788620305.669598:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd1132 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.669618:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd1132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.669632:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd1132 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620305.669657:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1788620305.670113:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd112b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2581 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.670132:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd1132 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2581 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.670142:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620305.670145:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788620305.670148:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548600, rc 0) 00000100:00100000:1.0:1788620305.670229:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11509:x1875504045047552:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 2017us (2297us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788620305.670239:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 187 00000100:00100000:2.0:1788620305.677354:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620305.677432:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045047680 00000100:00100000:1.0:1788620305.677444:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045047680 00000100:00100000:1.0:1788620305.677521:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 188 00000100:00100000:1.0:1788620305.677532:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11509:x1875504045047680:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:1.0:1788620305.677625:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.677643:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.677655:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.677670:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.677678:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.677686:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.677993:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678002:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678009:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620305.678049:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678083:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678090:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678097:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678103:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620305.678107:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678115:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678127:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620305.678130:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620305.678134:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678140:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1140 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678153:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678159:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678166:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678177:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620305.678180:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678187:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678195:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d64c7c2700) 00010000:00010000:1.0:1788620305.678198:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620305.678201:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678207:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd1147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678222:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678228:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678234:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678238:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620305.678241:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678246:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678406:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620305.678409:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620305.678412:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.678419:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd114e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620305.678509:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11509:x1875504045047680:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 978us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620305.678518:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 188 00010000:00010000:1.0:1788620305.707359:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620305.730407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620305.730662:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045047936 00000100:00100000:2.0:1788620305.730673:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045047936 00000100:00100000:2.0:1788620305.730771:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 189 00000100:00100000:2.0:1788620305.730785:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11512:x1875504045047936:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620305.730814:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620305.730843:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2588 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731009:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731031:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731047:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731067:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731075:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731082:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731567:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731577:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731583:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620305.731594:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788620305.731695:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731703:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731715:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731722:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620305.731726:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731734:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731748:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620305.731751:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620305.731755:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731762:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd115c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731772:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731778:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731783:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731788:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620305.731791:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731804:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731812:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620305.731815:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620305.731817:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731823:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731869:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731884:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.731892:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:2.0:1788620305.731894:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620305.731896:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2600, rc 0) 00000100:00100000:2.0:1788620305.731961:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:11512:x1875504045047936:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1179us (1564us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788620305.731969:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 189 00000100:00100000:3.0:1788620305.736370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620305.736720:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045048064 00000100:00100000:1.0:1788620305.736732:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045048064 00000100:00100000:1.0:1788620305.736792:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 190 00000100:00100000:1.0:1788620305.736804:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:11512:x1875504045048064:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:1.0:1788620305.736903:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.736923:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.736935:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.736966:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.736974:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.736989:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.736996:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620305.737000:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.737008:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.737021:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:1.0:1788620305.737025:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788620305.737031:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.737038:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd1178 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620305.737133:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:11512:x1875504045048064:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 331us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620305.737141:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 190 00000100:00100000:0.0:1788620305.741604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620305.741698:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045048320 00000100:00100000:3.0:1788620305.741716:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045048320 00000100:00100000:3.0:1788620305.741783:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:3.0:1788620305.741797:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:11512:x1875504045048320:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:3.0:1788620305.742083:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:11512:x1875504045048320:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 288us (488us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788620305.750816:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:0.0:1788620305.795115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620305.802037:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045048576 00000100:00100000:1.0:1788620305.802063:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045048576 00000100:00100000:1.0:1788620305.802127:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 191 00000100:00100000:1.0:1788620305.802137:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:11037:x1875504045048576:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:1.0:1788620305.802161:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620305.802181:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd117f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b258f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.802327:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.802341:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.802350:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.802382:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.802396:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 28 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620305.802409:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061816832:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620305.802511:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6486f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620305.816856:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620305.817234:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045048704 00000100:00100000:2.0:1788620305.817266:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045048704 00010000:00010000:2.0:1788620305.817307:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 29 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620305.817355:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 73 00000100:00100000:2.0:1788620305.817364:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:2355:x1875504045048704:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620305.817379:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620305.817387:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 29 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.817400:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 29 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.817422:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:2.0:1788620305.817428:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.817437:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.817444:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.817473:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620305.817525:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:2355:x1875504045048704:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 161us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620305.817534:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 73 00010000:00010000:1.0:1788620305.818154:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd116a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2588 expref: 28 pid: 5840 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620305.818173:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061816832:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620305.818201:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.818210:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.818228:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620305.818380:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788620305.818533:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd117f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.818549:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.818557:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:1.0:1788620305.818560:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788620305.818562:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620305.818600:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:11037:x1875504045048576:12345-192.168.201.11@tcp:101:bash.0 Request processed in 16465us (23496us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788620305.818607:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 191 00000100:00100000:2.0:1788620305.828628:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620305.828839:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045048960 00000100:00100000:3.0:1788620305.828850:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045048960 00000100:00100000:3.0:1788620305.828918:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 192 00000100:00100000:3.0:1788620305.828930:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:11037:x1875504045048960:12345-192.168.201.11@tcp:36:bash.0 00010000:00010000:3.0:1788620305.829193:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.829210:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.829222:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788620305.829622:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788620305.830017:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6f02269 reply state 00000000ef1029f8 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620305.830028:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788620305.830087:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788620305.830201:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:11037:x1875504045048960:12345-192.168.201.11@tcp:36:bash.0 Request processed in 1271us (1581us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788620305.830209:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 192 00000020:00080000:3.0:1788620305.830214:0:8736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788620305.832823:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.832838:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.832846:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.832851:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620305.832856:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.832972:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.832989:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:3.0:1788620305.832992:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620305.832996:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.833002:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620305.834109:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620305.834204:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045049088 00000100:00100000:0.0:1788620305.834218:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045049088 00000100:00100000:0.0:1788620305.834315:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 193 00000100:00100000:0.0:1788620305.834327:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:11037:x1875504045049088:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620305.834369:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620305.834387:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd119b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2596 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.834445:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd119b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2596 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.834468:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd119b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2596 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.834489:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:0.0:1788620305.834493:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620305.834496:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031800, rc 0) 00000100:00100000:0.0:1788620305.834554:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:11037:x1875504045049088:12345-192.168.201.11@tcp:101:bash.0 Request processed in 229us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620305.834560:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 193 00000100:00100000:2.0:1788620305.837055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620305.837173:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045049216 00000100:00100000:0.0:1788620305.837183:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045049216 00000100:00100000:0.0:1788620305.837316:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00100000:0.0:1788620305.837327:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:11037:x1875504045049216:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620305.837342:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620305.837362:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b259d expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788620305.837389:0:7779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c2e0d, atime: 0x6a9c2e0c, ctime: 0x6a9c2e0d, blocks: 0xb 00010000:00010000:0.0:1788620305.837409:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788620305.837414:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620305.837435:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.837452:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.837474:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030e00, rc 0) 00000100:00100000:0.0:1788620305.837530:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:11037:x1875504045049216:12345-192.168.201.11@tcp:101:bash.0 Request processed in 204us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620305.837537:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00080000:2.0:1788620305.839589:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620305.839783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620305.839874:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045049344 00000100:00100000:2.0:1788620305.839885:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045049344 00002000:00010000:2.0:1788620305.839931:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788620305.839936:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d680391880 with x1875504045049344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788620305.839950:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d680391880. 00000100:00100000:2.0:1788620305.840021:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620305.840031:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2353:x1875504045049344:12345-192.168.201.11@tcp:10:bash.0 00002000:00010000:2.0:1788620305.840341:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788620305.840345:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788620301 -> 1788620305 00002000:00010000:2.0:1788620305.840347:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788620300 -> 1788620300 00002000:00010000:2.0:1788620305.840349:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788620301 -> 1788620305 00002000:00010000:2.0:1788620305.840351:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788620305.840406:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2353:x1875504045049344:12345-192.168.201.11@tcp:10:bash.0 Request processed in 376us (628us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788620305.840414:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00002000:00010000:2.0:1788620305.840417:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788620305.840420:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d680391880 with x1875504045049344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788620305.840425:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d680391880. 00000100:00100000:3.0:1788620305.895132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620305.895245:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045049472 00000100:00100000:2.0:1788620305.895568:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045049472 00000100:00100000:3.0:1788620305.895741:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 194 00000100:00100000:3.0:1788620305.895752:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:11526:x1875504045049472:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:3.0:1788620305.895851:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.895871:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.895906:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.895924:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.895932:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.895938:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896455:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896477:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896485:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788620305.896528:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896540:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896546:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896552:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896568:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620305.896572:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896579:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896592:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:3.0:1788620305.896596:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620305.896600:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896605:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd11a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896619:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896625:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896631:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896636:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620305.896639:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896646:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896662:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d65309e900) 00010000:00010000:3.0:1788620305.896665:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620305.896668:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896673:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd11b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896691:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896709:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896715:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896719:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620305.896722:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896727:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896734:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:3.0:1788620305.896737:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620305.896740:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620305.896745:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd11b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620305.896844:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:11526:x1875504045049472:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 1091us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620305.896853:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 194 00000100:00100000:3.0:1788620305.941066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620305.941308:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045049728 00000100:00100000:0.0:1788620305.941317:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045049728 00000100:00100000:0.0:1788620305.941364:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 195 00000100:00100000:0.0:1788620305.941373:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+32:11529:x1875504045049728:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620305.941393:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620305.941412:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd11be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25a4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.941506:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.941521:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.941533:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.941548:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.941567:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.941574:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942219:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd11d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942230:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd11d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942237:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd11d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620305.942282:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788620305.942368:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942376:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942384:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942389:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620305.942393:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942400:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942421:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:0.0:1788620305.942424:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620305.942428:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942435:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd11c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942447:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942452:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942470:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942475:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620305.942478:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942485:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942491:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d642f43500) 00010000:00010000:0.0:1788620305.942493:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620305.942496:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942501:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030c00/0x24857de440bd11cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942550:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031e00/0x24857de440bd11be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25a4 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942563:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd11d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25a4 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.942570:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:0.0:1788620305.942572:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788620305.942574:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518200, rc 0) 00000100:00100000:0.0:1788620305.942942:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11529:x1875504045049728:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1567us (1892us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788620305.942950:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 195 00000100:00100000:2.0:1788620305.945862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620305.945995:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045049856 00000100:00100000:0.0:1788620305.946007:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045049856 00000100:00100000:0.0:1788620305.946067:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 196 00000100:00100000:0.0:1788620305.946076:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11529:x1875504045049856:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:0.0:1788620305.946153:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.946169:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.946177:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.946207:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620305.946238:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 34 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620305.946281:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e56680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061816960:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620305.946366:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620305.948688:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e56680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061816960:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620305.948720:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620305.948829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620305.950009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045050112 00000100:00100000:0.0:1788620305.950020:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045050112 00000100:00100000:0.0:1788620305.950078:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:0.0:1788620305.950088:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:5590:x1875504045050112:12345-192.168.201.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788620305.950428:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+36:5590:x1875504045050112:12345-192.168.201.11@tcp:35:ldlm_bl.0 Request processed in 342us (1601us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788620305.950434:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:3.0:1788620305.953355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620305.953453:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045050240 00000100:00100000:1.0:1788620305.953475:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045050240 00010000:00010000:1.0:1788620305.953520:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 36 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620305.953565:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 74 00000100:00100000:1.0:1788620305.953576:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+36:2355:x1875504045050240:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620305.953592:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620305.953599:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 36 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.953636:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 36 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.953660:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd1186 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b258f expref: 36 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.953675:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:1.0:1788620305.953681:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.953690:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.953703:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620305.953791:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620305.954036:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:2355:x1875504045050240:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 461us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620305.954043:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 74 00010000:00010000:2.0:1788620305.959678:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.959696:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.960043:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.960115:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.960123:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.960129:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620305.960133:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.960141:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.960160:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:2.0:1788620305.960164:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620305.960169:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620305.960175:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd11e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620305.961999:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11529:x1875504045049856:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 15843us (16070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620305.962012:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 196 00000100:00100000:3.0:1788620305.965482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620305.967668:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045050496 00000100:00100000:0.0:1788620305.967683:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045050496 00000100:00100000:0.0:1788620305.967754:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:0.0:1788620305.967765:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+34:11529:x1875504045050496:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620305.968022:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:11529:x1875504045050496:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 257us (2548us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788620305.968031:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:3.0:1788620306.032578:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.032750:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045050752 00000100:00100000:1.0:1788620306.032763:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045050752 00000100:00100000:1.0:1788620306.032885:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 197 00000100:00100000:1.0:1788620306.032898:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+35:11540:x1875504045050752:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:1.0:1788620306.032921:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.032938:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd11e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033031:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033046:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033057:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033067:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033072:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033076:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033355:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd11fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033361:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd11fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033365:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd11fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620306.033372:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788620306.033445:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033450:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033474:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033481:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620306.033485:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033493:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033505:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620306.033509:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620306.033514:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033520:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd11ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033533:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033539:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033545:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033549:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620306.033552:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033567:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033574:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620306.033576:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620306.033579:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033584:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd11f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033620:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd11e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ab expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033703:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd11fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ab expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.033711:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:1.0:1788620306.033714:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620306.033716:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620306.033817:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:11540:x1875504045050752:12345-192.168.201.11@tcp:101:cat.0 Request processed in 922us (1250us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788620306.033823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 197 00000100:00100000:2.0:1788620306.037364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.037435:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045051008 00000100:00100000:0.0:1788620306.037453:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045051008 00000100:00100000:0.0:1788620306.037546:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 54 00000100:00100000:0.0:1788620306.037557:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:11540:x1875504045051008:12345-192.168.201.11@tcp:35:cat.0 00000100:00100000:0.0:1788620306.037768:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:11540:x1875504045051008:12345-192.168.201.11@tcp:35:cat.0 Request processed in 213us (411us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788620306.037776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 54 00000100:00100000:3.0:1788620306.050200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.050381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045051264 00000100:00100000:1.0:1788620306.050389:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045051264 00000100:00100000:2.0:1788620306.050498:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 198 00000100:00100000:2.0:1788620306.050511:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:11541:x1875504045051264:12345-192.168.201.11@tcp:36:rm.0 00010000:00010000:2.0:1788620306.050590:0:8736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788620306.050676:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd11fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ab expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050702:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd11d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25a4 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050711:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd119b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2596 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050719:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:2.0:1788620306.050779:0:8736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620306.050802:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050815:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050823:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050833:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050837:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.050842:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.051386:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.051393:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.051398:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620306.051981:0:8736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788620306.051991:0:8736:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356090740220ns, next at 357090737818ns, rc = 0 00010000:00010000:2.0:1788620306.052049:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052056:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052060:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052065:0:8736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052069:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052073:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052087:0:8736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620306.052106:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052119:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052121:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620306.052125:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052127:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052131:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620306.052135:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052141:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620306.052143:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052144:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052156:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052158:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7cf00) 00010000:00010000:2.0:1788620306.052161:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788620306.052165:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052166:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0d647f7cf00) 00010000:00010000:1.0:1788620306.052169:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788620306.052171:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1219 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052172:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052177:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1220 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052188:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.052189:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620306.052191:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620306.052193:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620306.052194:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052199:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052204:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620306.052213:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052218:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052223:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620306.052224:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620306.052226:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.052230:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd120b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620306.052320:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d1cbc6e reply state 0000000002efb5a5 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.052328:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620306.052434:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+37:11541:x1875504045051264:12345-192.168.201.11@tcp:36:rm.0 Request processed in 1924us (2240us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788620306.052440:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 198 00010000:00010000:3.0:1788620306.054683:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.054700:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.054707:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.054713:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620306.054719:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.054727:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.054742:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d647f7c700) 00010000:00010000:3.0:1788620306.054745:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620306.054749:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.054786:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1212 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.087897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.088021:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045051520 00000100:00100000:0.0:1788620306.088033:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045051520 00000100:00100000:0.0:1788620306.088100:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 199 00000100:00100000:0.0:1788620306.088111:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+36:11547:x1875504045051520:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620306.088134:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620306.088153:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd1227 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25b2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.088346:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.088363:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.088374:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.088389:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.088397:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.088404:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620306.088997:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788620306.089152:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089161:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089169:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089200:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089208:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089215:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089221:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620306.089225:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089231:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089242:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:0.0:1788620306.089245:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620306.089275:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089294:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd122e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620306.089308:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e54bdd16 reply state 000000002423b5df transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620306.089318:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788620306.089349:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd1227 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089364:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.089372:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d642f43400) 00010000:00010000:0.0:1788620306.089374:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620306.089377:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518800, rc 0) 00000100:00100000:0.0:1788620306.089473:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:11547:x1875504045051520:12345-192.168.201.11@tcp:101:bash.0 Request processed in 1363us (1973us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788620306.089481:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 199 00010000:00010000:3.0:1788620306.091822:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.091839:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.091845:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.091852:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620306.091857:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.091865:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.091883:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d642f43500) 00010000:00010000:3.0:1788620306.091886:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620306.091892:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.091898:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd1235 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.094892:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.095048:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045051648 00000100:00100000:0.0:1788620306.095059:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045051648 00000100:00100000:0.0:1788620306.095189:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:0.0:1788620306.095200:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504045051648:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620306.095220:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620306.095239:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25b9 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788620306.095315:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620306.095340:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1788620306.095345:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620306.095353:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 6 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.095372:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 6 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.095386:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519000, rc 0) 00000100:00100000:0.0:1788620306.095461:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2354:x1875504045051648:12345-192.168.201.11@tcp:101:bash.0 Request processed in 254us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620306.095469:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00080000:2.0:1788620306.097741:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620306.099058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.099207:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045051776 00000100:00100000:1.0:1788620306.099217:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045051776 00000100:00100000:1.0:1788620306.099304:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:1.0:1788620306.099314:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:11547:x1875504045051776:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:1.0:1788620306.099333:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.099350:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25c0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.099380:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.099405:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620306.099409:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620306.099415:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.099447:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 7 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.099472:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 7 pid: 12010 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.099485:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875504061817088:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620306.099587:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6486f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788620306.102499:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875504061817088:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620306.102574:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.102597:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c548400, rc 0) 00000100:00100000:3.0:1788620306.102717:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:11547:x1875504045051776:12345-192.168.201.11@tcp:101:bash.0 Request processed in 3403us (3667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620306.102726:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:2.0:1788620306.105344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.108179:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045051904 00000100:00100000:0.0:1788620306.108197:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045051904 00010000:00010000:0.0:1788620306.108326:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 7 pid: 12010 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620306.108426:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:0.0:1788620306.108438:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045051904:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620306.108463:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620306.108488:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 7 pid: 12010 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.108533:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 7 pid: 12010 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.108558:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7cee44f/0x24857de440bd124a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b9 expref: 7 pid: 12010 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.108574:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620306.108577:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620306.108586:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.108595:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.108650:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620306.108665:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875504061817216:192.168.201.11@tcp:105: 00000100:00100000:0.0:1788620306.108758:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620306.113723:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875504061817216:192.168.201.11@tcp:105: 00010000:00010000:0.0:1788620306.113752:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620306.113816:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2355:x1875504045051904:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 5379us (8478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620306.113911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:1.0:1788620306.116695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620306.116967:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045052160 00000100:00100000:3.0:1788620306.116996:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045052160 00000100:00100000:3.0:1788620306.117054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:3.0:1788620306.117063:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+38:11547:x1875504045052160:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:3.0:1788620306.117444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:11547:x1875504045052160:12345-192.168.201.11@tcp:35:bash.0 Request processed in 381us (761us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788620306.117463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 55 00000100:00100000:3.0:1788620306.284550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.284986:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045052288 00000100:00100000:1.0:1788620306.284996:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045052288 00000100:00100000:1.0:1788620306.285114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 200 00000100:00100000:1.0:1788620306.285125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+39:11563:x1875504045052288:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620306.285150:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.285170:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd1258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.285235:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd125f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.285306:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.285317:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620306.285375:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788620306.285380:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620306.285401:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.285425:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd1258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c7 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.285445:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c7 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.285466:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620306.285469:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788620306.285473:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549200, rc 0) 00000100:00100000:1.0:1788620306.285541:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:11563:x1875504045052288:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 418us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.285549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 200 00000100:00100000:3.0:1788620306.289109:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.289433:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045052544 00000100:00100000:0.0:1788620306.289446:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045052544 00000100:00100000:0.0:1788620306.289551:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 201 00000100:00100000:0.0:1788620306.289564:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68039b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+40:11563:x1875504045052544:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620306.289597:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620306.289632:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd1266 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.289742:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd126d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.289756:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd126d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.289768:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd126d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620306.289780:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788620306.289930:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd1266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ce expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.289949:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd126d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ce expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.289959:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d642f43400) 00010000:00010000:0.0:1788620306.289962:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620306.289967:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519c00, rc 0) 00000100:00100000:0.0:1788620306.290035:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68039b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+42:11563:x1875504045052544:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 475us (936us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788620306.290059:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 201 00000100:00100000:3.0:1788620306.292387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.292488:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045052800 00000100:00100000:2.0:1788620306.292497:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045052800 00000100:00100000:2.0:1788620306.292549:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 202 00000100:00100000:2.0:1788620306.292559:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+42:11563:x1875504045052800:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620306.292582:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620306.292599:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd127b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25d5 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.292692:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1282 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.292705:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.292716:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620306.292727:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788620306.292849:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd127b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25d5 expref: 45 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.292867:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25d5 expref: 44 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.292875:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d642f43400) 00010000:00010000:2.0:1788620306.292878:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788620306.292881:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2e00, rc 0) 00000100:00100000:2.0:1788620306.292989:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+44:11563:x1875504045052800:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 432us (610us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788620306.292996:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 202 00000100:00100000:2.0:1788620306.294801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.294945:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045052928 00000100:00100000:0.0:1788620306.294954:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045052928 00000100:00100000:0.0:1788620306.295021:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:0.0:1788620306.295032:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+44:2355:x1875504045052928:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620306.295045:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620306.295070:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd126d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ce expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.295088:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d642f43400) 00010000:00010000:0.0:1788620306.295093:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620306.295149:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:2355:x1875504045052928:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 120us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620306.295159:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:2.0:1788620306.298959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.299047:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045053056 00000100:00100000:1.0:1788620306.299057:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045053056 00000100:00100000:1.0:1788620306.299133:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:1.0:1788620306.299141:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+6:2353:x1875504045053056:12345-192.168.201.11@tcp:1:lfs.0 00010000:00010000:1.0:1788620306.299179:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.299207:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.299213:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620306.299216:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620306.299220:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.299284:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.299295:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 6 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.299305:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875504061817344:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620306.299374:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6486f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620306.301026:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875504061817344:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620306.301053:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.301700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.301756:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045053184 00000100:00100000:1.0:1788620306.301764:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045053184 00002000:00100000:1.0:1788620306.301803:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0d6804c0700 x1875504045053184/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:402/0 lens 504/0 e 0 to 0 dl 1788620317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788620306.301826:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d6804c0700 with x1875504045053184 ext(0->8) 00010000:00010000:1.0:1788620306.301832:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 7 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.301842:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 7 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620306.301847:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d6804c0700 00000100:00100000:1.0:1788620306.301873:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:1.0:1788620306.301879:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045053184:12345-192.168.201.11@tcp:4:lfs.0 00000100:00100000:1.0:1788620306.302384:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2356:x1875504045053184:12345-192.168.201.11@tcp:4:lfs.0 Request processed in 503us (685us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788620306.302390:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 3 00002000:00100000:1.0:1788620306.302395:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0d6804c0700 x1875504045053184/t4294967308(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:402/0 lens 504/448 e 0 to 0 dl 1788620317 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788620306.302401:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d6804c0700 with x1875504045053184 ext(0->8) 00010000:00010000:1.0:1788620306.302405:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 9 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.302413:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 9 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620306.302418:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0d6804c0700 00000100:00100000:3.0:1788620306.304931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.304987:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045053312 00000100:00100000:2.0:1788620306.304995:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045053312 00010000:00010000:2.0:1788620306.305027:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 9 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.305072:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 76 00000100:00100000:2.0:1788620306.305081:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2355:x1875504045053312:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620306.305096:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788620306.305115:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788620306.305118:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788620305 00002000:00010000:2.0:1788620306.305120:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788620305 00002000:00010000:2.0:1788620306.305121:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788620305 00010000:00010000:2.0:1788620306.305126:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 9 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.305135:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 9 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.305153:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027781b9a/0x24857de440bd1251 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c0 expref: 9 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.305167:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788620306.305170:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788620306.305175:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.305181:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.305206:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788620306.305274:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.305290:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.305307:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504045053312:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 227us (383us total) trans 0 rc 0/0 00010000:00010000:1.0:1788620306.305313:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.305314:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 76 00010000:00010000:1.0:1788620306.305320:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.305328:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.305335:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620306.305339:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.305348:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.305359:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.305366:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad2692ce/0x24857de440bd1290 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.305416:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045053056:12345-192.168.201.11@tcp:1:lfs.0 Request processed in 6277us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.305422:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:2.0:1788620306.309207:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620306.309508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045053568 00000100:00100000:3.0:1788620306.309521:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045053568 00000100:00100000:3.0:1788620306.309591:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 56 00000100:00100000:3.0:1788620306.309601:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+43:11563:x1875504045053568:12345-192.168.201.11@tcp:35:lfs.0 00000004:00010000:3.0:1788620306.309679:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25d5 expref: 43 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788620306.309931:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788620306.309993:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788620306.310367:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788620306.310418:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.310432:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.310442:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.310494:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.310510:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 47 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.310525:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6809f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061817472:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620306.310613:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788620306.312784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.312850:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045053696 00000100:00100000:2.0:1788620306.312868:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045053696 00010000:00010000:2.0:1788620306.312909:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 48 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.312948:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 77 00000100:00100000:2.0:1788620306.312955:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+48:2355:x1875504045053696:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620306.312966:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620306.312971:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 48 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.312980:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 48 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.312998:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d642f43400) 00010000:00010000:2.0:1788620306.313002:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.313009:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.313014:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.313027:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620306.313074:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+48:2355:x1875504045053696:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 120us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620306.313079:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 77 00010000:00010000:1.0:1788620306.313234:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd123c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25b2 expref: 47 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.313283:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6809f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875504061817472:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620306.313305:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.313313:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.313319:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788620306.313422:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788620306.313630:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788620306.313740:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061817600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788620306.313795:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620306.313813:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675ccbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620306.313864:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061817600 00000100:00100000:3.0:1788620306.313869:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061817600 00000100:00100000:3.0:1788620306.313919:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620306.313927:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061817600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788620306.313978:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061817600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620306.313983:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620306.314004:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788620306.314008:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788620306.314025:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d67f815500, transno 4294967307 00000100:00100000:3.0:1788620306.314034:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061817600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788620306.314392:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788620306.314468:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061817728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788620306.314510:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620306.314531:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620306.314544:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061817728 00000100:00100000:3.0:1788620306.314548:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061817728 00000100:00100000:3.0:1788620306.314567:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620306.314573:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875504061817728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788620306.314698:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875504061817728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (188us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788620306.314705:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788620306.314873:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875504061817728:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788620306.314884:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788620306.314919:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788620306.314953:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.314961:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.314968:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.314973:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620306.314977:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.314991:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.315006:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d642f43400) 00010000:00010000:0.0:1788620306.315009:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788620306.315013:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.315020:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1297 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620306.315169:0:5842:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788620306.315528:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788620306.315541:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356354290392ns, next at 357354288198ns, rc = 0 00000001:00080000:0.0:1788620306.315548:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788620306.315837:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d642f43400) 00010000:00010000:0.0:1788620306.315841:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788620306.315847:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1282 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25d5 expref: 51 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620306.315953:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:11563:x1875504045053568:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 6352us (6760us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788620306.315962:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 56 00000020:00080000:0.0:1788620306.315966:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788620306.317552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.317637:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045053824 00000100:00100000:1.0:1788620306.317646:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045053824 00000100:00100000:1.0:1788620306.317702:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 203 00000100:00100000:1.0:1788620306.317712:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+50:11563:x1875504045053824:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620306.317735:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.317771:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd129e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25dc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.317829:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd129e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25dc expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.317843:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd129e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25dc expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.317860:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620306.317863:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788620306.317866:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d64c549000, rc 0) 00000100:00100000:1.0:1788620306.317917:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:11563:x1875504045053824:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 207us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.317922:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 203 00000100:00100000:2.0:1788620306.322626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.322723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045054080 00000100:00100000:1.0:1788620306.322733:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045054080 00000100:00100000:1.0:1788620306.322828:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 57 00000100:00100000:1.0:1788620306.322840:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+51:11563:x1875504045054080:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:1.0:1788620306.323091:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11563:x1875504045054080:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 253us (522us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788620306.323100:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 57 00000100:00100000:2.0:1788620306.387052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.387150:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045054208 00000100:00100000:1.0:1788620306.387161:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045054208 00000100:00100000:1.0:1788620306.387224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 204 00000100:00100000:1.0:1788620306.387235:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11573:x1875504045054208:12345-192.168.201.11@tcp:34:lfs.0 00010000:00010000:1.0:1788620306.387566:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387687:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387699:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387717:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387724:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387732:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387851:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387859:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387866:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620306.387906:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387917:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387923:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387940:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387946:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620306.387950:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387958:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387970:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620306.387973:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620306.387977:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387984:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549e00/0x24857de440bd12a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.387998:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388003:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388008:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388012:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620306.388015:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388031:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388039:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d64c7c2700) 00010000:00010000:1.0:1788620306.388041:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620306.388044:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388049:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548400/0x24857de440bd12ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388065:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388071:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388077:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388082:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620306.388085:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388091:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388097:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620306.388100:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620306.388102:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.388117:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.388234:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11573:x1875504045054208:12345-192.168.201.11@tcp:34:lfs.0 Request processed in 999us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.388243:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 204 00000100:00100000:3.0:1788620306.420194:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.420476:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045054464 00000100:00100000:1.0:1788620306.420487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045054464 00000100:00100000:1.0:1788620306.420617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 205 00000100:00100000:1.0:1788620306.420629:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+52:11576:x1875504045054464:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620306.420651:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.420674:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420752:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420769:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420780:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420798:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420806:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420833:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420958:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420967:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.420974:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620306.420983:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788620306.421081:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421088:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421095:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421101:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620306.421105:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421113:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421125:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620306.421128:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620306.421138:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421145:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd12c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421159:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421165:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421171:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421176:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620306.421179:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421185:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421192:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d64c7c2700) 00010000:00010000:1.0:1788620306.421195:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620306.421197:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421203:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd12c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421240:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd12ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421323:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.421331:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620306.421333:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620306.421335:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2e600, rc 0) 00000100:00100000:1.0:1788620306.421395:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:11576:x1875504045054464:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 769us (1213us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788620306.421402:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 205 00000100:00100000:2.0:1788620306.427858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.427995:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045054592 00000100:00100000:0.0:1788620306.428004:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045054592 00000100:00100000:0.0:1788620306.428052:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 206 00000100:00100000:0.0:1788620306.428059:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:11576:x1875504045054592:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:0.0:1788620306.428152:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428166:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428175:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428200:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428205:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428209:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428213:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620306.428216:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428220:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428230:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620306.428232:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788620306.428238:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.428245:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620306.428366:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:11576:x1875504045054592:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 306us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620306.428374:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 206 00000100:00100000:2.0:1788620306.430802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.430981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045054848 00000100:00100000:0.0:1788620306.430990:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045054848 00000100:00100000:0.0:1788620306.431033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00100000:0.0:1788620306.431040:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+54:11576:x1875504045054848:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620306.431222:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11576:x1875504045054848:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 182us (429us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788620306.431228:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 58 00000100:00100000:3.0:1788620306.504335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.504431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045055104 00000100:00100000:0.0:1788620306.504442:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045055104 00000100:00100000:0.0:1788620306.504545:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 207 00000100:00100000:0.0:1788620306.504556:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11586:x1875504045055104:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620306.505532:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620306.505538:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788620306.505580:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549200/0x24857de440bd125f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25c7 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.505603:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:0.0:1788620306.505608:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620306.505783:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.505898:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.505926:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.505934:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.505970:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.505986:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 55 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620306.506000:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061817856:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620306.506104:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d647f050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620306.510789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.510857:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061817856:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620306.510902:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.511147:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045055232 00000100:00100000:3.0:1788620306.511156:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045055232 00010000:00010000:3.0:1788620306.511197:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 56 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.511322:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 78 00000100:00100000:3.0:1788620306.511333:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+56:2356:x1875504045055232:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620306.511347:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620306.511354:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 56 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.511381:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 56 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.511403:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e600/0x24857de440bd12cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25e3 expref: 56 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.511420:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620306.511424:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.511433:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.511440:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.512083:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620306.512142:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:2356:x1875504045055232:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 809us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620306.512151:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 78 00010000:00010000:0.0:1788620306.512192:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.512200:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620306.512219:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788620306.512698:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd12e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.512730:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.512736:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620306.512739:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788620306.512741:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518800, rc 0) 00000100:00100000:0.0:1788620306.512768:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11586:x1875504045055104:12345-192.168.201.11@tcp:101:bash.0 Request processed in 8214us (8445us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788620306.512775:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 207 00000100:00100000:2.0:1788620306.518098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620306.518773:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045055488 00000100:00100000:3.0:1788620306.518785:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045055488 00000100:00100000:3.0:1788620306.518976:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 208 00000100:00100000:3.0:1788620306.518988:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+55:11586:x1875504045055488:12345-192.168.201.11@tcp:36:bash.0 00010000:00010000:3.0:1788620306.519291:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.519307:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.519331:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788620306.519383:0:8736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788620306.519406:0:8736:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b41da1e2 reply state 0000000060907002 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.519415:0:8736:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620306.519533:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11586:x1875504045055488:12345-192.168.201.11@tcp:36:bash.0 Request processed in 547us (1444us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788620306.519541:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 208 00000020:00080000:3.0:1788620306.519547:0:8736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788620306.524840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.524923:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045055616 00000100:00100000:1.0:1788620306.524934:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045055616 00000100:00100000:1.0:1788620306.525019:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 209 00000100:00100000:1.0:1788620306.525030:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11586:x1875504045055616:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:1.0:1788620306.525056:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.525078:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd1300 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.525159:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.525174:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.525182:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.525188:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.525221:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.525278:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.525291:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 59 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.525305:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061817984:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620306.525386:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788620306.528382:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.528398:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.528405:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.528410:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620306.528415:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.528422:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.528441:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620306.528444:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620306.528667:0:3295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.528679:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.528686:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd12f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.529007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.529161:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875504061817984:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620306.529185:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.529289:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045055744 00000100:00100000:3.0:1788620306.529296:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045055744 00010000:00010000:3.0:1788620306.529328:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 59 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.529355:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:3.0:1788620306.529365:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:2355:x1875504045055744:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620306.529378:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620306.529385:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 59 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.529396:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 59 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.529415:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518800/0x24857de440bd12eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ea expref: 59 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.529426:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620306.529430:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.529784:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.529793:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.529854:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620306.529917:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:2355:x1875504045055744:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 553us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620306.529925:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 79 00010000:00010000:1.0:1788620306.531810:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.531828:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620306.531903:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788620306.531907:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620306.531929:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.531967:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd1300 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.532007:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.532016:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620306.532019:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620306.532022:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2f400, rc 0) 00000100:00100000:1.0:1788620306.532089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11586:x1875504045055616:12345-192.168.201.11@tcp:101:bash.0 Request processed in 7059us (7259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.532100:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 209 00000100:00100000:2.0:1788620306.536149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.536290:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045056000 00000100:00100000:0.0:1788620306.536301:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045056000 00000100:00100000:0.0:1788620306.536355:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:0.0:1788620306.536366:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+57:11586:x1875504045056000:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:0.0:1788620306.536839:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11586:x1875504045056000:12345-192.168.201.11@tcp:35:bash.0 Request processed in 473us (698us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788620306.536847:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 59 00000100:00100000:2.0:1788620306.603777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.603888:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045056128 00000100:00100000:1.0:1788620306.603898:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045056128 00000100:00100000:1.0:1788620306.603958:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 210 00000100:00100000:1.0:1788620306.603969:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+58:11592:x1875504045056128:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620306.603995:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.604016:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd130e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25f8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.604083:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.604098:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.604108:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620306.604167:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788620306.604186:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620306.604213:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.604281:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd130e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f8 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.604302:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f8 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.604311:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620306.604314:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788620306.604317:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2f000, rc 0) 00000100:00100000:1.0:1788620306.604381:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11592:x1875504045056128:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 414us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.604389:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 210 00000100:00100000:2.0:1788620306.612038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620306.612132:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045056256 00000100:00100000:0.0:1788620306.612143:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045056256 00000100:00100000:0.0:1788620306.612202:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 211 00000100:00100000:0.0:1788620306.612213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11592:x1875504045056256:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:0.0:1788620306.612242:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620306.612285:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd131c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b25ff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612351:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612378:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612391:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612405:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612412:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612417:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612540:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.612547:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613029:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620306.613068:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788620306.613072:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620306.613092:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613105:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613129:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613134:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613141:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613147:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620306.613151:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613159:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613172:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:0.0:1788620306.613175:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620306.613181:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613187:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613203:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613209:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613215:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613826:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620306.613831:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613838:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613847:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d642f43400) 00010000:00010000:0.0:1788620306.613850:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620306.613852:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.613858:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd132a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.614214:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519000/0x24857de440bd131c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.614241:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620306.614271:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620306.614274:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620306.614277:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518200, rc 0) 00000100:00100000:0.0:1788620306.614365:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11592:x1875504045056256:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 2152us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620306.614373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 211 00000100:00100000:2.0:1788620306.622123:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.622168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.622471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045056512 00000100:00100000:1.0:1788620306.622482:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045056512 00000100:00100000:1.0:1788620306.622547:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 212 00000100:00100000:1.0:1788620306.622568:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11592:x1875504045056512:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620306.622596:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620306.622619:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd1338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2606 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.623031:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.623050:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.623071:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.623079:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.623124:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.623140:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 61 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.623155:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061818112:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620306.623359:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.623368:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 61 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.623377:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061818240:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620306.623398:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67fb3e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620306.623723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045056640 00000100:00100000:3.0:1788620306.623729:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045056640 00010000:00010000:3.0:1788620306.623754:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 62 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620306.623790:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 80 00000100:00100000:3.0:1788620306.623798:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:2356:x1875504045056640:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620306.623810:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620306.623816:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 62 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.623828:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 62 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.623844:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620306.623849:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.623866:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.623872:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620306.623896:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:2356:x1875504045056640:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 99us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620306.623903:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 80 00010000:00010000:1.0:1788620306.630392:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.11@tcp) returned -22 from blocking AST (req@0000000007ff6b75 x1875504061818112) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 61 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.630419:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25ff expref: 61 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.630468:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061818112:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620306.630485:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061818240:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620306.630520:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620306.630527:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.630537:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.630546:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620306.633240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.633871:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045056768 00000100:00100000:1.0:1788620306.633882:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045056768 00010000:00010000:1.0:1788620306.633920:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 61 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620306.633972:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 81 00000100:00100000:1.0:1788620306.633981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:2355:x1875504045056768:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620306.633998:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620306.634005:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 61 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.634019:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 61 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.634056:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f400/0x24857de440bd1307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f1 expref: 61 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.634071:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620306.634076:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.634085:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.634092:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.634171:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620306.634218:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:2355:x1875504045056768:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 237us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.634225:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 81 00010000:00010000:2.0:1788620306.636224:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.636482:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620306.636830:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788620306.637074:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd1338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.637095:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.637115:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620306.637118:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788620306.637121:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2fa00, rc 0) 00000100:00100000:2.0:1788620306.637285:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11592:x1875504045056512:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 14719us (15172us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788620306.637294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 212 00000100:00100000:2.0:1788620306.645656:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620306.645792:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057024 00000100:00100000:3.0:1788620306.645803:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057024 00000100:00100000:3.0:1788620306.645867:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:3.0:1788620306.645878:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11592:x1875504045057024:12345-192.168.201.11@tcp:103:lfs.0 00010000:00010000:3.0:1788620306.645895:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620306.645922:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549000/0x24857de440bd129e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25dc expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620306.645944:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620306.645948:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620306.646014:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11592:x1875504045057024:12345-192.168.201.11@tcp:103:lfs.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620306.646022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:0.0:1788620306.651868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.651971:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057152 00000100:00100000:1.0:1788620306.651982:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057152 00000100:00100000:1.0:1788620306.652054:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 213 00000100:00100000:1.0:1788620306.652065:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11592:x1875504045057152:12345-192.168.201.11@tcp:58:lfs.0 00010000:00010000:1.0:1788620306.652203:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.652221:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620306.652233:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788620306.652526:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788620306.652638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11592:x1875504045057152:12345-192.168.201.11@tcp:58:lfs.0 Request processed in 574us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.652646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 213 00000100:00100000:1.0:1788620306.659377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.664790:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057280 00000100:00100000:2.0:1788620306.664805:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057280 00000100:00100000:2.0:1788620306.664886:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 214 00000100:00100000:2.0:1788620306.664896:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+59:11592:x1875504045057280:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620306.664926:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620306.664948:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b260d expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.665005:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.665016:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 60 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.665036:0:8736:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.665050:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 60 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.665084:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620306.665087:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620306.665092:0:8736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 60 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620306.665099:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3e00, rc 0) 00000100:00100000:2.0:1788620306.665157:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11592:x1875504045057280:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 262us (5789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620306.665165:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 214 00010000:00010000:3.0:1788620306.728409:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620306.770187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.770244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.770295:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620306.770318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620306.770394:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057536 00000100:00100000:1.0:1788620306.770403:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057536 00000100:00100000:1.0:1788620306.770466:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057664 00000100:00100000:1.0:1788620306.770470:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057664 00000100:00100000:1.0:1788620306.770498:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 73 00000100:00100000:1.0:1788620306.770509:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2354:x1875504045057536:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620306.770612:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2354:x1875504045057536:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 104us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.770620:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 73 00000100:00100000:1.0:1788620306.770638:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 74 00000100:00100000:1.0:1788620306.770644:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045057664:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620306.770670:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045057664:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.770677:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 74 00000100:00100000:1.0:1788620306.770699:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057792 00000100:00100000:1.0:1788620306.770702:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057792 00000100:00080000:1.0:1788620306.770724:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620306.770752:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 146 00000100:00100000:1.0:1788620306.770760:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045057792:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620306.770789:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045057792:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620306.770810:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 146 00000100:00100000:0.0:1788620306.774980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057408 00000100:00100000:0.0:1788620306.774994:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057408 00000100:00100000:0.0:1788620306.775061:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 292 00000100:00100000:0.0:1788620306.775070:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045057408:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620306.775143:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045057408:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 75us (4898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620306.775148:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 292 00000040:00080000:3.0:1788620307.049048:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620307.049057:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620307.049115:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788620307.049123:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788620307.049473:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061818368:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788620307.049869:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788620307.053945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.054080:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061818368:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788620307.054901:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045057920 00000100:00100000:0.0:1788620307.054911:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045057920 00000100:00100000:0.0:1788620307.055048:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 215 00000100:00100000:0.0:1788620307.055060:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11594:x1875504045057920:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788620307.055094:0:8736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788620307.055205:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11594:x1875504045057920:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 148us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620307.055213:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 215 00000100:00100000:3.0:1788620307.060014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.060067:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045058048 00000100:00100000:3.0:1788620307.060077:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045058048 00000100:00100000:3.0:1788620307.060134:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 216 00000100:00100000:3.0:1788620307.060144:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11594:x1875504045058048:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788620307.060655:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060676:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060692:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060711:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060719:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060726:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060751:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060760:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060791:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620307.060837:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788620307.060842:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620307.060857:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060879:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060886:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060892:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060897:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620307.060902:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060909:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060922:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:3.0:1788620307.060925:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620307.060930:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060936:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd135b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060962:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060968:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060975:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060980:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620307.060983:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060988:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.060996:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffffa0d65309e900) 00010000:00010000:3.0:1788620307.060999:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620307.061002:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061007:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1362 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061024:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061031:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061036:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061046:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620307.061049:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061055:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061063:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620307.061065:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620307.061068:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.061073:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620307.061166:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11594:x1875504045058048:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 Request processed in 1020us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.061176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 216 00000100:00100000:3.0:1788620307.068798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.069667:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045058304 00000100:00100000:2.0:1788620307.069682:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045058304 00000100:00100000:2.0:1788620307.069756:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 217 00000100:00100000:2.0:1788620307.069769:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d68084f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+60:11594:x1875504045058304:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620307.069794:0:8736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620307.069815:0:8736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1370 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2614 expref: -99 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.069931:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.069948:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.069975:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620307.069988:0:8736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788620307.070102:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070109:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070116:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070122:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620307.070127:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070133:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070146:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:2.0:1788620307.070149:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788620307.070154:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070161:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd1377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070203:0:8736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1370 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2614 expref: 62 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070225:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:2.0:1788620307.070227:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620307.070232:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1370 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2614 expref: 62 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.070242:0:8736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2c00, rc 0) 00000100:00100000:2.0:1788620307.071661:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d68084f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11594:x1875504045058304:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 1880us (2857us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788620307.071677:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 217 00000100:00080000:1.0:1788620307.072353:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620307.076944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.077133:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045058432 00000100:00100000:1.0:1788620307.077145:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045058432 00000100:00100000:1.0:1788620307.077209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 218 00000100:00100000:1.0:1788620307.077232:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11594:x1875504045058432:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788620307.077294:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788620307.077396:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11594:x1875504045058432:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 177us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.077405:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 218 00000100:00100000:3.0:1788620307.081114:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.083469:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045058688 00000100:00100000:2.0:1788620307.083496:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045058688 00000100:00100000:2.0:1788620307.083564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 219 00000100:00100000:2.0:1788620307.083576:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11594:x1875504045058688:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620307.083596:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620307.083598:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788620307.083637:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b25f8 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.083656:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620307.083661:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620307.083673:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1385 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b261b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788620307.084065:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788620307.084312:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd138c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.084325:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd138c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.084335:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd138c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.084378:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1385 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b261b expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.084392:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd138c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b261b expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.084400:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:2.0:1788620307.084403:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620307.084405:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2e00, rc 0) 00000100:00100000:2.0:1788620307.084495:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11594:x1875504045058688:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 919us (3391us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788620307.084502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 219 00000100:00100000:0.0:1788620307.091896:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.091998:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045058944 00000100:00100000:2.0:1788620307.092018:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045058944 00000100:00100000:2.0:1788620307.092074:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 220 00000100:00100000:2.0:1788620307.092083:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11594:x1875504045058944:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788620307.092140:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620307.092167:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2e00/0x24857de440bd138c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b261b expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092205:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7ce00) 00010000:00010000:2.0:1788620307.092215:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620307.092247:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092290:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092299:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092314:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092320:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092327:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092401:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092408:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092415:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092420:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620307.092424:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092448:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092458:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:2.0:1788620307.092460:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620307.092464:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092469:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3400/0x24857de440bd139a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092694:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092703:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092710:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092715:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620307.092718:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092724:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092732:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb88a255e (ffffa0d647f7c500) 00010000:00010000:2.0:1788620307.092734:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620307.092737:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.092753:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd13a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb88a255e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.094139:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11594:x1875504045058944:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 2045us (2241us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620307.094150:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 220 00000100:00100000:3.0:1788620307.098769:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.098857:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045059072 00000100:00100000:2.0:1788620307.098878:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045059072 00000100:00100000:2.0:1788620307.098947:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 221 00000100:00100000:2.0:1788620307.098958:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+61:11594:x1875504045059072:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620307.098978:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620307.098999:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd13a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2622 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.099033:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.099045:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.099055:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.099158:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd13a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.099178:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.099188:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620307.099191:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788620307.099202:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2a00, rc 0) 00000100:00100000:2.0:1788620307.099302:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11594:x1875504045059072:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 345us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620307.099309:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 221 00000100:00100000:3.0:1788620307.113120:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.113939:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045059328 00000100:00100000:1.0:1788620307.113956:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045059328 00000100:00100000:1.0:1788620307.114016:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 222 00000100:00100000:1.0:1788620307.114028:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+62:11594:x1875504045059328:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788620307.114127:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.114148:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.114163:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788620307.114494:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788620307.114506:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357153255125ns, next at 358153252153ns, rc = 0 00000004:00010000:1.0:1788620307.114620:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e62f25ed reply state 000000002a2a38e8 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.114650:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788620307.114869:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+64:11594:x1875504045059328:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 842us (1759us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788620307.114877:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 222 00010000:00010000:2.0:1788620307.118904:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.118926:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.118934:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.118941:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620307.118946:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.118954:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.118973:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620307.118976:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788620307.118981:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.118988:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd13b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620307.120912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.121174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045059456 00000100:00100000:3.0:1788620307.121185:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045059456 00000100:00100000:3.0:1788620307.121273:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 223 00000100:00100000:3.0:1788620307.121283:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+63:11594:x1875504045059456:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620307.121304:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620307.121323:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2629 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.121396:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.121411:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.121431:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:3.0:1788620307.121444:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620307.121449:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643c00, rc 0) 00000100:00100000:3.0:1788620307.121583:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+64:11594:x1875504045059456:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 300us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.121783:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 223 00000100:00100000:3.0:1788620307.124941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.125094:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045059584 00000100:00100000:1.0:1788620307.125104:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045059584 00000100:00100000:1.0:1788620307.125175:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00100000:1.0:1788620307.125185:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2355:x1875504045059584:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788620307.125767:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620307.126010:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:2355:x1875504045059584:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 824us (1078us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788620307.126019:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00100000:2.0:1788620307.139137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.139724:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045059840 00000100:00100000:1.0:1788620307.139734:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045059840 00000100:00100000:1.0:1788620307.139799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:1.0:1788620307.139810:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+64:11594:x1875504045059840:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788620307.140550:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+65:11594:x1875504045059840:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 736us (1416us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788620307.140561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 60 00000100:00100000:2.0:1788620307.156061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.156229:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045060096 00000100:00100000:1.0:1788620307.156238:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045060096 00000100:00100000:1.0:1788620307.156312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 224 00000100:00100000:1.0:1788620307.156322:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+65:11594:x1875504045060096:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788620307.156450:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+65:11594:x1875504045060096:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 114us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.156459:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 224 00000100:00100000:2.0:1788620307.159915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.160084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045060224 00000100:00100000:3.0:1788620307.160094:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045060224 00000100:00100000:3.0:1788620307.160154:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 225 00000100:00100000:3.0:1788620307.160165:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+65:11594:x1875504045060224:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620307.160187:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620307.160211:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd13c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2630 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.160344:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd13cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.160360:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd13cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.160384:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd13cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620307.160421:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620307.160450:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd13cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.160899:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd13c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2630 expref: 67 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.160925:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd13cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2630 expref: 66 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.160935:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:3.0:1788620307.160937:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788620307.160941:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642200, rc 0) 00000100:00100000:1.0:1788620307.161119:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+66:11594:x1875504045060224:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 954us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.161138:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 225 00000100:00100000:2.0:1788620307.166168:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.166280:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045060352 00000100:00100000:1.0:1788620307.166291:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045060352 00000100:00100000:1.0:1788620307.166351:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 63 00000100:00100000:1.0:1788620307.166362:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+10:2356:x1875504045060352:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620307.166379:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620307.166400:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2637 expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620307.166425:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2e12, blocks: 0x1 00010000:00010000:1.0:1788620307.166453:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1788620307.166458:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620307.166468:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 11 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.166756:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 11 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.166773:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2e200, rc 0) 00000100:00100000:1.0:1788620307.166882:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:2356:x1875504045060352:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 521us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.166889:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 63 00000100:00100000:2.0:1788620307.174155:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.174399:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045060608 00000100:00100000:1.0:1788620307.174409:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045060608 00000100:00100000:1.0:1788620307.174501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 226 00000100:00100000:1.0:1788620307.174512:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+66:11594:x1875504045060608:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788620307.174664:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+66:11594:x1875504045060608:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 153us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.174672:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 226 00000100:00100000:0.0:1788620307.179104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.179197:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045060736 00000100:00100000:3.0:1788620307.179209:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045060736 00000100:00100000:3.0:1788620307.179307:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:3.0:1788620307.179318:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+11:11594:x1875504045060736:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620307.179335:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620307.179353:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b263e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.179384:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 12 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.179406:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620307.179410:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620307.179415:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.179460:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 12 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.179474:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 12 pid: 12010 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620307.179487:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875504061818496:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620307.179581:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620307.184348:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1875504061818496:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620307.184391:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.184412:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643600, rc 0) 00000100:00100000:3.0:1788620307.185151:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:11594:x1875504045060736:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 5832us (6055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.185162:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:2.0:1788620307.187297:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.187574:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045060864 00000100:00100000:1.0:1788620307.187723:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045060864 00010000:00010000:1.0:1788620307.187770:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 12 pid: 12010 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.187813:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:1.0:1788620307.187823:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:2356:x1875504045060864:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620307.187837:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620307.187871:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 12 pid: 12010 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.187886:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 12 pid: 12010 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.187910:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2637 expref: 12 pid: 12010 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.187927:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620307.187931:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620307.187944:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.188119:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.188162:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.188177:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875504061818624:192.168.201.11@tcp:105: 00000100:00100000:1.0:1788620307.188461:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6486f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788620307.192364:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.192461:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045060992 00000100:00100000:2.0:1788620307.192472:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045060992 00002000:00100000:2.0:1788620307.192525:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffffa0d666e57100 x1875504045060992/t0(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:403/0 lens 504/0 e 0 to 0 dl 1788620318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788620307.192537:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d666e57100 with x1875504045060992 ext(0->12) 00002000:00010000:2.0:1788620307.192796:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d666e57100 00000100:00100000:2.0:1788620307.192840:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:2.0:1788620307.192851:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:2356:x1875504045060992:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788620307.193393:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+14:2356:x1875504045060992:12345-192.168.201.11@tcp:4:lhsmtool_posix.0 Request processed in 541us (1036us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788620307.193403:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00002000:00100000:2.0:1788620307.193410:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffffa0d666e57100 x1875504045060992/t4294967320(0) o4->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:403/0 lens 504/448 e 0 to 0 dl 1788620318 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788620307.193418:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d666e57100 with x1875504045060992 ext(0->12) 00002000:00010000:2.0:1788620307.193422:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d666e57100 00000100:00100000:1.0:1788620307.193894:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875504061818624:192.168.201.11@tcp:105: 00010000:00010000:1.0:1788620307.193923:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620307.193948:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2356:x1875504045060864:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 6128us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.193955:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:2.0:1788620307.196151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620307.196366:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045061120 00000100:00100000:0.0:1788620307.196377:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045061120 00000100:00100000:1.0:1788620307.196475:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 227 00000100:00100000:1.0:1788620307.196488:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+66:11594:x1875504045061120:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788620307.222832:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:3.0:1788620307.222857:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788620307.222891:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d67a1199c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788620307.222907:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d64844f100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d67a1190c0 00000020:00080000:3.0:1788620307.222911:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d64844ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d67f74b400 00000020:00080000:3.0:1788620307.222927:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1788620307.222933:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788620307.222939:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788620307.222978:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788620307.222993:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d68085cf00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788620307.222996:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d680855700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d68085c000 00000020:00080000:3.0:1788620307.222999:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d680855000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d649f27000 00000100:00100000:3.0:1788620307.223153:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061818752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788620307.223225:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620307.223328:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061818752 00000100:00100000:3.0:1788620307.223332:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620307.223335:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061818752 00000100:00100000:3.0:1788620307.223338:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061818880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788620307.223362:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620307.223386:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061818880 00000100:00100000:3.0:1788620307.223389:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061818880 00000100:00100000:1.0:1788620307.223390:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788620307.223398:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1875504061818752:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788620307.223408:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788620307.223414:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3309:x1875504061818880:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:1.0:1788620307.223423:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788620307.223455:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.223478:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 12 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.223555:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788620307.223560:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620307.223565:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620307.223569:0:12010:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788620307.223572:0:12010:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788620306 00002000:00010000:3.0:1788620307.223575:0:12010:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788620307.223577:0:12010:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788620306 -> 1788620306 00002000:00010000:3.0:1788620307.223580:0:12010:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788620307.223615:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3309:x1875504061818880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (251us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788620307.223622:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1788620307.223671:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d6808e9f80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788620307.223676:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061818880:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788620307.224143:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 12 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.224161:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 12 pid: 7779 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.224174:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061819008:192.168.201.11@tcp:104: 00000020:00080000:0.0:1788620307.224185:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1788620307.224237:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620307.224300:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620307.224310:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061819136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788620307.224339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788620307.224523:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788620307.224633:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061819136 00000100:00100000:0.0:1788620307.224639:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061819136 00000100:00100000:0.0:1788620307.224679:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788620307.224687:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061819136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788620307.224704:0:7779:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788620307.224732:0:7779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c2e11, atime: 0x6a9c2e11, ctime: 0x6a9c2e11, blocks: 0x1 00010000:00010000:0.0:1788620307.224739:0:7779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.224749:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1788620307.224753:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620307.224759:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.224776:0:7779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.224786:0:7779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.224794:0:7779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.224817:0:7779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620307.225473:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620307.225491:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.225501:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620307.225505:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.225531:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.225558:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.225566:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089b876d1/0x24857de440bd13e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.225584:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620307.225586:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620307.225588:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620307.225765:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875504061819136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1077us (1424us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788620307.225784:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1788620307.227118:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d666e54000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788620307.227130:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061819136:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788620307.227237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620307.227386:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:11594:x1875504045061120:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 Request processed in 30898us (31241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620307.227396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 227 00000100:00100000:3.0:1788620307.233240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.233412:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061819008:192.168.201.11@tcp:104: 00010000:00010000:1.0:1788620307.233452:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.233649:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045061248 00000100:00100000:0.0:1788620307.233657:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045061248 00010000:00010000:0.0:1788620307.233696:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 13 pid: 7779 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.233734:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 83 00000100:00100000:0.0:1788620307.233744:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+13:2356:x1875504045061248:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620307.233760:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620307.233766:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 13 pid: 7779 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.233779:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 13 pid: 7779 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.233803:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd11a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b259d expref: 13 pid: 7779 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.233819:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620307.233823:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788620307.233828:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.233838:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.233891:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620307.233949:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:2356:x1875504045061248:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 205us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620307.233958:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 83 00010000:00010000:1.0:1788620307.234014:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.234024:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.234047:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.234055:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.234080:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788620307.234699:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3311:x1875504061818752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11299us (11480us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788620307.234709:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1788620307.234756:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d6808eb800/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788620307.234762:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061818752:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788620307.235143:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620307.235151:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.235161:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620307.235165:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.235175:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.235190:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.235198:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd13e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.235233:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620307.235234:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620307.235236:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620307.239565:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.239806:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045061376 00000100:00100000:3.0:1788620307.239817:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045061376 00000100:00100000:3.0:1788620307.239891:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:3.0:1788620307.239903:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+12:2355:x1875504045061376:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788620307.283516:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1788620307.283531:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1788620307.283563:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1788620307.283812:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2355:x1875504045061376:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 Request processed in 43905us (44251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.283824:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:0.0:1788620307.286522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.287369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045061632 00000100:00100000:3.0:1788620307.287382:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045061632 00000100:00100000:3.0:1788620307.288399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 228 00000100:00100000:3.0:1788620307.288413:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:11594:x1875504045061632:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788620307.288474:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620307.288501:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd13cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2630 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.288520:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:3.0:1788620307.288525:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620307.288555:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.288569:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.288579:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788620307.289474:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005fff82d reply state 00000000f8b0fe74 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620307.289501:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620307.289612:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:11594:x1875504045061632:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 1193us (3090us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788620307.289620:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 228 00000100:00100000:1.0:1788620307.292501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00010000:00010000:3.0:1788620307.292565:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.292578:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.292586:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.292592:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620307.292597:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.292619:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.292637:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:3.0:1788620307.292640:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620307.292646:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.292651:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd13ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.293202:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045061760 00000100:00100000:0.0:1788620307.293213:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045061760 00000100:00100000:0.0:1788620307.293456:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:0.0:1788620307.293467:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045061760:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788620307.293813:0:7779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788620307.293818:0:7779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788620306 -> 1788620306 00002000:00010000:0.0:1788620307.293821:0:7779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788620305 00002000:00010000:0.0:1788620307.293823:0:7779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788620306 -> 1788620306 00002000:00010000:0.0:1788620307.293825:0:7779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788620307.293927:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2353:x1875504045061760:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 461us (1437us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788620307.293935:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:2.0:1788620307.296349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620307.296464:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045062016 00000100:00100000:0.0:1788620307.296485:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045062016 00000100:00100000:0.0:1788620307.296541:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 229 00000100:00100000:0.0:1788620307.296551:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:11594:x1875504045062016:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788620307.296630:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.296646:0:8736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.296655:0:8736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.296691:0:8736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.296711:0:8736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 20 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.296727:0:8736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061819264:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620307.297521:0:8736:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788620307.300867:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.301407:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045062144 00000100:00100000:3.0:1788620307.301417:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045062144 00010000:00010000:3.0:1788620307.301488:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 21 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620307.301536:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 84 00000100:00100000:3.0:1788620307.301547:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:2355:x1875504045062144:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620307.301561:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620307.301569:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 21 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.301581:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 21 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.301702:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:3.0:1788620307.301708:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.301718:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.301726:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.301747:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620307.301805:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:2355:x1875504045062144:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 260us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.301813:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 84 00010000:00010000:0.0:1788620307.303007:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2a00/0x24857de440bd13af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2622 expref: 20 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.303028:0:8736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e55500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8736:1875504061819264:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620307.303049:0:8736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303058:0:8736:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303063:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303093:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303100:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303107:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303113:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620307.303131:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303139:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303152:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:0.0:1788620307.303155:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788620307.303159:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.303165:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd13f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.303345:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:11594:x1875504045062016:12345-192.168.201.11@tcp:55:lhsmtool_posix.0 Request processed in 6795us (7005us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788620307.303354:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 229 00000100:00100000:1.0:1788620307.304498:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620307.304518:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061819392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620307.304577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620307.305045:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061819776:0@lo:400:kworker.0 00000100:00100000:2.0:1788620307.305078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620307.305101:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788620307.305107:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061819648:0@lo:400:kworker.0 00000100:00100000:2.0:1788620307.305130:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620307.305153:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061819904:0@lo:400:kworker.0 00000100:00100000:2.0:1788620307.305177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620307.305195:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620307.305201:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061819520:0@lo:400:kworker.0 00000100:00100000:3.0:1788620307.305371:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061819776 00000100:00100000:3.0:1788620307.305379:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061819776 00000100:00100000:3.0:1788620307.305427:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061819648 00000100:00100000:3.0:1788620307.305453:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061819648 00000100:00100000:3.0:1788620307.305470:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061819904 00000100:00100000:3.0:1788620307.305473:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061819904 00000100:00100000:3.0:1788620307.305490:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788620307.305500:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061819776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620307.305550:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061819776:12345-0@lo:400:kworker.0 Request processed in 51us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.305557:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788620307.305573:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788620307.305579:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061819648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620307.305720:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061819648:12345-0@lo:400:kworker.0 Request processed in 140us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.305727:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788620307.305741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788620307.305748:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061819904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620307.305777:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061819904:12345-0@lo:400:kworker.0 Request processed in 30us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.305783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788620307.306036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620307.306078:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061819904:0@lo:400:kworker.0 00000100:00080000:2.0:1788620307.306103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620307.306123:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061819648:0@lo:400:kworker.0 00000100:00100000:2.0:1788620307.306134:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061819776:0@lo:400:kworker.0 00000100:00100000:0.0:1788620307.306214:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061819392 00000100:00100000:0.0:1788620307.306219:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061819392 00000100:00100000:0.0:1788620307.306278:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788620307.306286:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875504061819392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620307.306302:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620307.306343:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875504061819392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620307.306348:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788620307.306380:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061819392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620307.306519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061819520 00000100:00100000:1.0:1788620307.306523:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061819520 00000100:00100000:1.0:1788620307.306559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788620307.306565:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061819520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620307.306716:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3310:x1875504061819520:12345-0@lo:400:kworker.0 Request processed in 151us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.306723:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788620307.307002:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061819520:0@lo:400:kworker.0 00000100:00100000:0.0:1788620307.310947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.311016:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045062272 00000100:00100000:1.0:1788620307.311026:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045062272 00000100:00100000:1.0:1788620307.311082:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:1.0:1788620307.311091:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2356:x1875504045062272:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788620307.311133:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.311154:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.311162:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620307.311166:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620307.311171:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.311210:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.311241:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 8 pid: 6689 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.311278:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061820032:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620307.311365:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620307.313767:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875504061820032:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620307.313829:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620307.315752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.315883:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045062400 00000100:00100000:1.0:1788620307.315892:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045062400 00010000:00010000:1.0:1788620307.315934:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 9 pid: 6689 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.315977:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 85 00000100:00100000:1.0:1788620307.315986:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+9:2355:x1875504045062400:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620307.316000:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620307.316023:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 9 pid: 6689 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.316037:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 9 pid: 6689 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.316061:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa094e1/0x24857de440bd13d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b263e expref: 9 pid: 6689 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.316079:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620307.316084:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620307.316090:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.316099:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.316130:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620307.316182:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2355:x1875504045062400:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 197us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.316201:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 85 00010000:00010000:3.0:1788620307.316921:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.316934:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.316965:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.316987:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.316996:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.317003:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fe00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620307.317008:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.317016:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.317029:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.317036:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd13fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620307.317118:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2356:x1875504045062272:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 Request processed in 6026us (6179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.317127:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 70 00000100:00100000:3.0:1788620307.321044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620307.321149:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045062656 00000100:00100000:0.0:1788620307.321159:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045062656 00000100:00100000:0.0:1788620307.321229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 230 00000100:00100000:0.0:1788620307.321239:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:11594:x1875504045062656:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788620307.321349:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.321367:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.321378:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.321593:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.321790:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.321800:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.321835:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.321848:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 20 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.321874:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e54700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061820160:192.168.201.11@tcp:104: 00000100:00100000:0.0:1788620307.322046:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788620307.326756:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e54700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061820160:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620307.326786:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.326850:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.327774:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045062784 00000100:00100000:3.0:1788620307.327784:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045062784 00010000:00010000:2.0:1788620307.328070:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 21 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620307.328148:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 86 00000100:00100000:2.0:1788620307.328159:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:2356:x1875504045062784:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620307.328174:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620307.328181:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 21 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.328207:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 21 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.328358:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd13bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2629 expref: 21 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.328378:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:2.0:1788620307.328384:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.328394:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.328402:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620307.328442:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620307.328506:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:2356:x1875504045062784:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 349us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620307.328514:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 86 00010000:00010000:0.0:1788620307.329570:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.329581:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620307.329794:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788620307.330102:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788620307.330149:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788620307.330283:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e54700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875504061820288:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788620307.330346:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620307.330375:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620307.331034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061820288 00000100:00100000:3.0:1788620307.331042:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061820288 00000100:00100000:3.0:1788620307.331098:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788620307.331109:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875504061820288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788620307.331202:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875504061820288:12345-0@lo:1000:mdt00_001.0 Request processed in 95us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620307.331211:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788620307.331562:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1788620307.331568:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d680399c00, transno 4294967315 00000004:00080000:0.0:1788620307.331586:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1788620307.332135:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d6808e9f80, transno 4294967321 00000004:00080000:0.0:1788620307.332140:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d6808eb800, transno 4294967322 00000100:00100000:0.0:1788620307.332147:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e54700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875504061820288:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788620307.333108:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788620307.333177:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e54700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875504061820416:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788620307.333387:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620307.333421:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788620307.333511:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061820416 00000100:00100000:3.0:1788620307.333519:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061820416 00000100:00100000:3.0:1788620307.333564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788620307.333574:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875504061820416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788620307.333772:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875504061820416:12345-0@lo:1000:mdt00_001.0 Request processed in 199us (384us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788620307.333781:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620307.334533:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e54700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5840:1875504061820416:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788620307.334571:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334581:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334589:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334595:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620307.334699:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334711:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334726:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d647f7c700) 00010000:00010000:1.0:1788620307.334729:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788620307.334735:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334741:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518000/0x24857de440bd140a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334772:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334779:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334793:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334798:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620307.334801:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334807:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334815:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620307.334818:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788620307.334825:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 23 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334835:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 23 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334844:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 23 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.334878:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 23 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.334891:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061820544:192.168.201.11@tcp:105: 00000100:00100000:1.0:1788620307.335023:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620307.340907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.340973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045062912 00000100:00100000:2.0:1788620307.340984:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045062912 00000100:00100000:2.0:1788620307.341039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:2.0:1788620307.341049:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11592:x1875504045062912:12345-192.168.201.11@tcp:49:lfs.0 00000100:00100000:0.0:1788620307.341270:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875504061820544:192.168.201.11@tcp:105: 00010000:00010000:0.0:1788620307.341301:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341312:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e000/0x24857de440bd134d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341345:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341358:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341369:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341378:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341384:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341390:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341396:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620307.341400:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341408:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341447:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620307.341451:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620307.341455:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341460:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519c00/0x24857de440bd1411 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341471:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341477:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341483:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341489:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620307.341492:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341497:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341505:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620307.341507:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788620307.341510:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.341515:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620307.341828:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788620307.341834:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620307.342337:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788620307.342346:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788620307.342877:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+24:11592:x1875504045062912:12345-192.168.201.11@tcp:49:lfs.0 Request processed in 1824us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620307.342888:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 61 00000100:00100000:0.0:1788620307.344121:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:11594:x1875504045062656:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 22877us (23079us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788620307.344132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 230 00000020:00080000:0.0:1788620307.344138:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788620307.345749:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.347714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620307.348943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045063168 00000100:00100000:1.0:1788620307.348957:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045063168 00000100:00100000:1.0:1788620307.349085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 231 00000100:00100000:1.0:1788620307.349096:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:11592:x1875504045063168:12345-192.168.201.11@tcp:58:lfs.0 00000040:00080000:1.0:1788620307.349498:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788620307.349591:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:11592:x1875504045063168:12345-192.168.201.11@tcp:58:lfs.0 Request processed in 497us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.349600:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 231 00000100:00100000:0.0:1788620307.351029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045063424 00000100:00100000:0.0:1788620307.351039:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045063424 00000100:00100000:0.0:1788620307.351088:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 62 00000100:00100000:0.0:1788620307.351097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+23:11594:x1875504045063424:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788620307.351742:0:5842:0:(mdd_object.c:4179:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788620307.351838:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788620307.351882:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.351897:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.351911:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.351919:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.351926:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.351942:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.351959:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788620307.352034:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+25:11594:x1875504045063424:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 937us (4325us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788620307.352042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 62 00000020:00080000:0.0:1788620307.352046:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788620307.352109:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620307.352115:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.352122:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620307.352126:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.352134:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.352145:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0d642f43000) 00010000:00010000:0.0:1788620307.352148:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788620307.352153:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.352159:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519800/0x24857de440bd1418 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.352175:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620307.352177:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620307.352179:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620307.403336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620307.403501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045063552 00000100:00100000:3.0:1788620307.403512:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045063552 00000100:00100000:3.0:1788620307.403562:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 232 00000100:00100000:3.0:1788620307.403572:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+25:11596:x1875504045063552:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620307.403598:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620307.403636:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd141f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2645 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.403708:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.403740:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.403753:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.403769:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.403777:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.403783:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.404102:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.404116:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.404125:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.404161:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.404177:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 26 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620307.404206:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061820672:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620307.405001:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d68085c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788620307.417062:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620307.417559:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045063808 00000100:00100000:2.0:1788620307.417572:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045063808 00000100:00100000:2.0:1788620307.417649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 63 00000100:00100000:2.0:1788620307.417660:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:5590:x1875504045063808:12345-192.168.201.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788620307.418228:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:5590:x1875504045063808:12345-192.168.201.11@tcp:35:ldlm_bl.0 Request processed in 561us (1167us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788620307.418238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 63 00000100:00100000:3.0:1788620307.420864:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875504061820672:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620307.420899:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620307.430890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620307.431077:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045063936 00000100:00100000:0.0:1788620307.431088:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045063936 00010000:00010000:0.0:1788620307.431134:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 28 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620307.431184:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 87 00000100:00100000:0.0:1788620307.431194:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:2356:x1875504045063936:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620307.431209:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620307.431218:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 28 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.431232:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 28 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.431294:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fa00/0x24857de440bd133f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2606 expref: 28 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.431312:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620307.431318:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.431328:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.431335:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620307.431483:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620307.431627:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:2356:x1875504045063936:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 432us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.431636:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 87 00010000:00010000:3.0:1788620307.436589:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620307.436672:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620307.436815:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788620307.436821:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620307.436845:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436862:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436874:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436881:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436890:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436896:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620307.436901:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436934:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436950:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:1.0:1788620307.436953:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620307.436957:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436963:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd1426 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436980:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436986:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436991:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.436996:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620307.436999:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.437004:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.437012:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0d65309ea00) 00010000:00010000:1.0:1788620307.437014:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620307.437018:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.437033:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd142d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.437079:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd141f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2645 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.437094:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2645 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620307.437101:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620307.437103:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788620307.437106:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643200, rc 0) 00000100:00100000:1.0:1788620307.437200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:11596:x1875504045063552:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 33626us (33872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.437209:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 232 00010000:00010000:1.0:1788620307.752542:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620307.816927:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061820800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620307.817005:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620307.817626:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061820800 00000100:00100000:1.0:1788620307.817636:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061820800 00000100:00100000:1.0:1788620307.817692:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788620307.817703:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061820800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620307.817728:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788620307.817792:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875504061820800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620307.817800:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788620307.817939:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061820800:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788620308.392567:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788620308.392580:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620308.392633:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788620308.392639:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788620308.392764:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e56300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061820928:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788620308.392871:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65089cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620308.396953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620308.397080:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045064064 00000100:00100000:1.0:1788620308.397091:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045064064 00000100:00100000:1.0:1788620308.397164:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 233 00000100:00100000:1.0:1788620308.397187:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:11607:x1875504045064064:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788620308.397227:0:8736:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788620308.397883:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+27:11607:x1875504045064064:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 695us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620308.397893:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 233 00000100:00100000:2.0:1788620308.398003:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e56300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875504061820928:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788620308.406888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620308.407406:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045064320 00000100:00100000:3.0:1788620308.407431:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045064320 00000100:00100000:3.0:1788620308.407507:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 234 00000100:00100000:3.0:1788620308.407518:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+26:11607:x1875504045064320:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620308.407538:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620308.407558:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd143b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b264c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.407695:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.407850:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.407870:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620308.407884:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788620308.408042:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd143b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b264c expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.408062:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b264c expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.408071:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620308.408075:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620308.408079:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642200, rc 0) 00000100:00100000:3.0:1788620308.408147:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:11607:x1875504045064320:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 631us (1267us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788620308.408158:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 234 00000100:00100000:0.0:1788620308.414455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620308.414617:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045064576 00000100:00100000:1.0:1788620308.414628:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045064576 00000100:00100000:1.0:1788620308.414689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 235 00000100:00100000:1.0:1788620308.414700:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:11607:x1875504045064576:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788620308.414787:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.414804:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.414816:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.415023:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.415031:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.415037:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.415042:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620308.415046:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.415060:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.415071:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620308.415074:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788620308.415078:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.415083:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd1450 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620308.416019:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620308.416027:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620308.416067:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788620308.416073:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788620308.428663:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:11607:x1875504045064576:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 13952us (14206us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788620308.428680:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 235 00000040:00080000:1.0:1788620308.428864:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788620308.428869:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788620308.429387:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788620308.429396:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788620308.431861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620308.434172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045064704 00000100:00100000:1.0:1788620308.434190:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045064704 00000100:00100000:1.0:1788620308.434302:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:1.0:1788620308.434313:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:2355:x1875504045064704:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620308.434332:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620308.434358:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642200/0x24857de440bd1442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b264c expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.434376:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620308.434390:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620308.434462:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:2355:x1875504045064704:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 151us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620308.434471:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:3.0:1788620308.444534:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620308.445008:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045064960 00000100:00100000:1.0:1788620308.445018:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045064960 00000100:00100000:1.0:1788620308.445078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:1.0:1788620308.445089:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+28:11607:x1875504045064960:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788620308.445363:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:11607:x1875504045064960:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 274us (838us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788620308.445370:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 64 00000100:00100000:0.0:1788620308.629463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620308.638779:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045065216 00000100:00100000:3.0:1788620308.638795:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045065216 00000100:00100000:3.0:1788620308.638906:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 236 00000100:00100000:3.0:1788620308.638919:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+29:11620:x1875504045065216:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620308.638970:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620308.638994:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2653 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.639111:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd145e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.639125:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd145e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.639137:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd145e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620308.639148:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788620308.639333:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642e00/0x24857de440bd1457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2653 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.639352:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd145e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2653 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.639362:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:3.0:1788620308.639365:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788620308.639370:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642000, rc 0) 00000100:00100000:3.0:1788620308.639458:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:11620:x1875504045065216:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 542us (10682us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788620308.639465:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 236 00000100:00100000:0.0:1788620308.647433:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620308.647788:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045065344 00000100:00100000:1.0:1788620308.647800:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045065344 00000100:00100000:1.0:1788620308.647861:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 237 00000100:00100000:1.0:1788620308.647873:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:11620:x1875504045065344:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:1.0:1788620308.647947:0:8736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.647964:0:8736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.647975:0:8736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.648000:0:8736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.648007:0:8736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.648025:0:8736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.648031:0:8736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620308.648036:0:8736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.648043:0:8736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.648055:0:8736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:1.0:1788620308.648058:0:8736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788620308.648063:0:8736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620308.648069:0:8736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f000/0x24857de440bd146c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620308.648143:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:11620:x1875504045065344:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 272us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620308.648151:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 237 00010000:00010000:0.0:1788620308.779341:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620308.781608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620308.781784:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045065472 00000100:00100000:3.0:1788620308.781796:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045065472 00000100:00100000:3.0:1788620308.781867:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 71 00000100:00100000:3.0:1788620308.781895:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045065472:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:3.0:1788620308.781927:0:12010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620308.781951:0:12010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005871b9a3/0x24857de440bd1473 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b265a expref: -99 pid: 12010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620308.781981:0:12010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c2e12, atime: 0x6a9c2e11, ctime: 0x6a9c2e12, blocks: 0xb 00010000:00010000:3.0:1788620308.782001:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788620308.782005:0:12010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620308.782015:0:12010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005871b9a3/0x24857de440bd1473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b265a expref: 8 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.782032:0:12010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005871b9a3/0x24857de440bd1473 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b265a expref: 8 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620308.782046:0:12010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642e00, rc 0) 00000100:00100000:3.0:1788620308.782123:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2354:x1875504045065472:12345-192.168.201.11@tcp:101:cat.0 Request processed in 230us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620308.782131:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 71 00000100:00100000:0.0:1788620308.789138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620308.789211:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045065600 00000100:00100000:1.0:1788620308.789223:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045065600 00002000:00100000:1.0:1788620308.789324:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffffa0d666e54e00 x1875504045065600/t0(0) o3->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:404/0 lens 488/0 e 0 to 0 dl 1788620319 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788620308.789336:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d666e54e00 with x1875504045065600 ext(0->4095) 00002000:00010000:1.0:1788620308.789341:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d666e54e00 00000100:00100000:1.0:1788620308.789369:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:1.0:1788620308.789377:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2353:x1875504045065600:12345-192.168.201.11@tcp:3:cat.0 00000100:00100000:2.0:1788620308.790132:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2353:x1875504045065600:12345-192.168.201.11@tcp:3:cat.0 Request processed in 520us (769us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788620308.790143:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00002000:00100000:2.0:1788620308.790151:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffffa0d666e54e00 x1875504045065600/t0(0) o3->6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a@192.168.201.11@tcp:404/0 lens 488/4536 e 0 to 0 dl 1788620319 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788620308.790160:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0d666e54e00 with x1875504045065600 ext(0->4095) 00002000:00010000:2.0:1788620308.790163:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0d666e54e00 00010000:00010000:0.0:1788620309.800635:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788620309.986022:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788620309.987430:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:1.0:1788620310.824638:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620311.851154:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620311.882559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620311.882608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620311.882634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620311.882662:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620311.882689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620311.882715:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045065728 00000100:00100000:0.0:1788620311.882725:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045065728 00000100:00100000:0.0:1788620311.882782:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 294 00000100:00100000:0.0:1788620311.882793:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045065728:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620311.882864:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045065728:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620311.882871:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 294 00000100:00100000:0.0:1788620311.882901:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045065984 00000100:00100000:0.0:1788620311.882905:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045065984 00000100:00100000:0.0:1788620311.882940:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045066112 00000100:00100000:0.0:1788620311.882943:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045066112 00000100:00100000:0.0:1788620311.882959:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:0.0:1788620311.882965:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2354:x1875504045065984:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620311.882990:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+8:2354:x1875504045065984:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620311.882995:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:0.0:1788620311.883005:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 76 00000100:00100000:0.0:1788620311.883010:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d648532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504045066112:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620311.883724:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045066240 00000100:00100000:1.0:1788620311.883731:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045066240 00000100:00100000:1.0:1788620311.883761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045065856 00000100:00100000:1.0:1788620311.883764:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045065856 00000100:00100000:1.0:1788620311.883784:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 150 00000100:00100000:1.0:1788620311.883792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045066240:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620311.883827:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:2354:x1875504045066240:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 37us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620311.883833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 150 00000100:00100000:1.0:1788620311.883845:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 151 00000100:00100000:1.0:1788620311.883851:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:2354:x1875504045065856:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620311.883870:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+31:2354:x1875504045065856:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 20us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620311.883876:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 151 00000100:00100000:0.0:1788620311.884551:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d648532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504045066112:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 1536us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620311.884561:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 76 00000100:00080000:0.0:1788620311.884848:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620311.884853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620311.884856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620312.424568:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061821056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620312.424655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620312.424734:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821056 00000100:00100000:1.0:1788620312.424742:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821056 00000100:00100000:1.0:1788620312.424797:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788620312.424807:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d675db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061821056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788620312.424840:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620312.424886:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d675db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061821056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620312.424905:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788620312.425091:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620312.425118:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788620312.425124:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788620312.425139:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d666e54000, transno 4294967310 00000100:00100000:1.0:1788620312.425156:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061821056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620312.425875:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061821184:0@lo:400:kworker.0 00000100:00100000:0.0:1788620312.425913:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061821568:0@lo:400:kworker.0 00000100:00100000:2.0:1788620312.425921:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620312.425941:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620312.425948:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061821696:0@lo:400:kworker.0 00000100:00100000:0.0:1788620312.425968:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821568 00000100:00100000:2.0:1788620312.425971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620312.425973:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821568 00000100:00100000:2.0:1788620312.425997:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061821312:0@lo:400:kworker.0 00000100:00100000:0.0:1788620312.426010:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788620312.426017:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061821568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620312.426027:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620312.426047:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620312.426052:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d666e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061821440:0@lo:400:kworker.0 00000100:00100000:0.0:1788620312.426052:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875504061821568:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620312.426059:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788620312.426071:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788620312.426076:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620312.426093:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061821568:0@lo:400:kworker.0 00000100:00100000:2.0:1788620312.426094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821184 00000100:00100000:2.0:1788620312.426097:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821184 00000100:00100000:0.0:1788620312.426126:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821696 00000100:00100000:0.0:1788620312.426129:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821696 00000100:00100000:0.0:1788620312.426153:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821312 00000100:00100000:0.0:1788620312.426156:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821312 00000100:00100000:0.0:1788620312.426166:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821440 00000100:00100000:0.0:1788620312.426168:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821440 00000100:00100000:0.0:1788620312.426182:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788620312.426199:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061821696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620312.427069:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788620312.427080:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061821184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620312.428013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788620312.428026:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061821312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620312.428090:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061821312:12345-0@lo:400:kworker.0 Request processed in 69us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620312.428097:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788620312.428118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788620312.428125:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061821440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620312.428166:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061821440:12345-0@lo:400:kworker.0 Request processed in 42us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620312.428172:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788620312.428563:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061821440:0@lo:400:kworker.0 00000100:00100000:3.0:1788620312.428576:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061821312:0@lo:400:kworker.0 00000100:00080000:3.0:1788620312.428966:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620312.430007:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061821696:12345-0@lo:400:kworker.0 Request processed in 3803us (4029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620312.430020:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788620312.435149:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3309:x1875504061821184:12345-0@lo:400:kworker.0 Request processed in 8060us (9216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620312.435165:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788620312.438095:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e39889e-8996-4811-9fe8-f1c6c0211740:3309:1875504061821184:0@lo:400:kworker.0 00000100:00100000:0.0:1788620312.438124:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d666e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061821696:0@lo:400:kworker.0 00000001:00080000:0.0:1788620312.477219:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1788620312.477235:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1788620312.479906:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:3.0:1788620312.479928:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0d67a27f840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788620312.479934:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d644c30200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0d67fb3e9c0 00000020:00080000:3.0:1788620312.479938:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0d644c30500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0d675c10400 00000020:00080000:3.0:1788620312.479961:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788620312.480000:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788620312.480433:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788620312.480939:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1788620312.480960:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00010000:00010000:2.0:1788620312.874376:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620312.937714:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061821824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620312.937788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620312.937915:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821824 00000100:00100000:1.0:1788620312.937924:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821824 00000100:00100000:1.0:1788620312.937976:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788620312.938006:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061821824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620312.938040:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620312.938088:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061821824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620312.938096:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788620312.938143:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788620312.938149:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788620312.938174:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061821824:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788620313.576771:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620313.576781:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620313.576822:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788620313.576830:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788620313.729793:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620313.729931:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045066368 00000100:00100000:0.0:1788620313.729941:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045066368 00000100:00100000:0.0:1788620313.730017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 238 00000100:00100000:0.0:1788620313.730027:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11273:x1875504045066368:12345-192.168.201.11@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788620313.730137:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11273:x1875504045066368:12345-192.168.201.11@tcp:60:lhsmtool_posix.0 Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620313.730146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 238 00000100:00080000:2.0:1788620313.730582:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620313.736396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620313.736758:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045066624 00000100:00100000:1.0:1788620313.736770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045066624 00000100:00100000:1.0:1788620313.736847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 65 00000100:00100000:1.0:1788620313.736860:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:11273:x1875504045066624:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788620313.737446:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:11273:x1875504045066624:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 587us (1058us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788620313.737464:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 65 00010000:00010000:1.0:1788620313.896531:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620314.021069:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620314.021209:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045066752 00000100:00100000:3.0:1788620314.021220:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045066752 00000100:00100000:3.0:1788620314.021342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 239 00000100:00100000:3.0:1788620314.021355:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+5:12070:x1875504045066752:12345-192.168.201.11@tcp:101:lsof.0 00010000:00010000:3.0:1788620314.021375:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620314.021396:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd147a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2661 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620314.021487:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1481 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620314.021499:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620314.021513:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620314.021736:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788620314.021741:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620314.021827:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620314.021855:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd147a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2661 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620314.021884:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2661 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620314.021894:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:3.0:1788620314.021897:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620314.021901:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643600, rc 0) 00000100:00100000:3.0:1788620314.021968:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08800a14-727c-477e-9a55-bbbe86f0530f+6:12070:x1875504045066752:12345-192.168.201.11@tcp:101:lsof.0 Request processed in 617us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620314.021976:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 239 00000100:00080000:2.0:1788620314.022147:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788620314.920566:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620315.946272:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620316.969432:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620317.001775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620317.001823:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620317.001859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620317.001889:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620317.001919:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620317.001948:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067392 00000100:00100000:2.0:1788620317.001957:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067392 00000100:00100000:2.0:1788620317.002033:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067008 00000100:00100000:2.0:1788620317.002037:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067008 00000100:00100000:2.0:1788620317.002062:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 155 00000100:00100000:2.0:1788620317.002073:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08800a14-727c-477e-9a55-bbbe86f0530f+6:2353:x1875504045067392:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620317.002178:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08800a14-727c-477e-9a55-bbbe86f0530f+6:2353:x1875504045067392:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620317.002187:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 155 00000100:00100000:2.0:1788620317.002206:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 156 00000100:00100000:2.0:1788620317.002213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:2353:x1875504045067008:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620317.002246:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:2353:x1875504045067008:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620317.002302:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 156 00000100:00080000:2.0:1788620317.002320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620317.002379:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067136 00000100:00100000:0.0:1788620317.002386:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067136 00000100:00100000:0.0:1788620317.002443:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067264 00000100:00100000:0.0:1788620317.002447:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067264 00000100:00100000:0.0:1788620317.002470:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 78 00000100:00100000:0.0:1788620317.002478:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045067136:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620317.002512:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2353:x1875504045067136:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 35us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620317.002519:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 78 00000100:00100000:0.0:1788620317.002533:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:0.0:1788620317.002539:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504045067264:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620317.002563:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2353:x1875504045067264:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 24us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620317.002570:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:1.0:1788620317.002793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045066880 00000100:00100000:1.0:1788620317.002797:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045066880 00000100:00100000:1.0:1788620317.002839:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 296 00000100:00100000:1.0:1788620317.002847:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045066880:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620317.002885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2353:x1875504045066880:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 39us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620317.002892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 296 00000100:00080000:2.0:1788620317.003221:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620317.003225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620317.544630:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061822336:0@lo:400:kworker.0 00000100:00100000:0.0:1788620317.544688:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061821952:0@lo:400:kworker.0 00000100:00100000:1.0:1788620317.544711:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620317.547232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620317.547321:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061822464:0@lo:400:kworker.0 00000100:00100000:1.0:1788620317.547367:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061821952 00000100:00100000:0.0:1788620317.547373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620317.547375:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061821952 00000100:00100000:0.0:1788620317.547412:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061822080:0@lo:400:kworker.0 00000100:00100000:1.0:1788620317.547423:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788620317.547433:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061821952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620317.549631:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061821952:12345-0@lo:400:kworker.0 Request processed in 2189us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620317.549648:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788620317.551312:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620317.551362:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061822592:0@lo:400:kworker.0 00000100:00100000:0.0:1788620317.551403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620317.551682:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788620317.551692:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061822208:0@lo:400:kworker.0 00000100:00100000:0.0:1788620317.551847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620317.551873:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061822720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620317.551931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620317.551984:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822336 00000100:00100000:0.0:1788620317.551995:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822336 00000100:00100000:0.0:1788620317.552054:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822592 00000100:00100000:0.0:1788620317.552057:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822592 00000100:00100000:0.0:1788620317.552084:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788620317.552092:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061822336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620317.552567:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061822336:12345-0@lo:400:kworker.0 Request processed in 473us (7854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620317.552575:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788620317.552594:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788620317.552601:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061822592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620317.552701:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061822336:0@lo:400:kworker.0 00000100:00100000:0.0:1788620317.552956:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061822592:12345-0@lo:400:kworker.0 Request processed in 355us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620317.552963:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788620317.552985:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822464 00000100:00100000:0.0:1788620317.552990:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822464 00000100:00100000:0.0:1788620317.553019:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822080 00000100:00100000:0.0:1788620317.553022:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822080 00000100:00100000:0.0:1788620317.553034:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822208 00000100:00100000:0.0:1788620317.553038:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822208 00000100:00100000:0.0:1788620317.553052:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788620317.553058:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061822464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620317.553137:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061821952:0@lo:400:kworker.0 00000100:00080000:2.0:1788620317.553948:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788620317.553956:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620317.553959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620317.553975:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822720 00000100:00100000:2.0:1788620317.553981:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822720 00000100:00100000:2.0:1788620317.554020:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788620317.554028:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061822720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620317.554059:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620317.554110:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061822720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620317.554129:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788620317.554156:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788620317.554164:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061822080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620317.554198:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061822080:12345-0@lo:400:kworker.0 Request processed in 36us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620317.554218:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788620317.554234:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788620317.554240:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061822208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620317.554306:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d649f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061822208:12345-0@lo:400:kworker.0 Request processed in 66us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620317.554312:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788620317.554394:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061822464:12345-0@lo:400:kworker.0 Request processed in 1335us (7019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620317.554401:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788620317.555405:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061822592:0@lo:400:kworker.0 00000100:00100000:1.0:1788620317.555488:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061822208:0@lo:400:kworker.0 00000100:00100000:1.0:1788620317.555508:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061822720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620317.555534:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061822080:0@lo:400:kworker.0 00000100:00100000:3.0:1788620317.556366:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061822464:0@lo:400:kworker.0 00000001:00080000:1.0:1788620317.603067:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788620317.603084:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788620317.603136:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788620317.603148:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:3.0:1788620317.739589:0:12715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:58:35 (1788620315) 00010000:00010000:2.0:1788620317.999894:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620318.060903:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061822848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620318.061003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620318.062159:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822848 00000100:00100000:1.0:1788620318.062172:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822848 00000100:00100000:1.0:1788620318.062241:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788620318.062296:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061822848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620318.062335:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620318.062424:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061822848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620318.062431:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788620318.067221:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061822848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788620319.018473:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620320.056308:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620321.064498:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620322.088563:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620322.119713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620322.119792:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620322.119837:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620322.119874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620322.119904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620322.119915:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045068032 00000100:00100000:2.0:1788620322.119923:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067648 00000100:00100000:2.0:1788620322.119925:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067648 00000100:00100000:1.0:1788620322.119925:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045068032 00000100:00100000:3.0:1788620322.119981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067520 00000100:00100000:3.0:1788620322.119986:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067520 00000100:00100000:3.0:1788620322.120027:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 298 00000100:00100000:3.0:1788620322.120038:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045067520:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620322.120105:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2354:x1875504045067520:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620322.120113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 298 00000100:00100000:0.0:1788620322.120338:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067776 00000100:00100000:0.0:1788620322.120344:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067776 00000100:00100000:2.0:1788620322.120430:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 160 00000100:00100000:0.0:1788620322.121583:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045067904 00000100:00100000:0.0:1788620322.121594:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045067904 00000100:00100000:0.0:1788620322.121623:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:0.0:1788620322.121633:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d666e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045067776:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620322.121691:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d666e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2354:x1875504045067776:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 60us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620322.121699:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:0.0:1788620322.121714:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 83 00000100:00100000:0.0:1788620322.122973:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504045067904:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620322.123033:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2354:x1875504045067904:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 1313us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620322.123043:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 83 00000100:00080000:3.0:1788620322.125348:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620322.125358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620322.125361:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620322.125573:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 161 00000100:00100000:1.0:1788620322.125978:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+6:2354:x1875504045068032:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620322.126071:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08800a14-727c-477e-9a55-bbbe86f0530f+6:2354:x1875504045068032:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 99us (6233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620322.126078:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 161 00000100:00100000:2.0:1788620322.131125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:2354:x1875504045067648:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620322.131277:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:2354:x1875504045067648:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 10812us (11375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620322.131288:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 160 00000100:00100000:0.0:1788620322.247063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620322.247162:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045068288 00000100:00100000:3.0:1788620322.247202:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045068288 00000100:00100000:3.0:1788620322.247305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 66 00000100:00100000:3.0:1788620322.247317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+18:12292:x1875504045068288:12345-192.168.201.11@tcp:35:umount.0 00000100:00100000:3.0:1788620322.248018:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:12292:x1875504045068288:12345-192.168.201.11@tcp:35:umount.0 Request processed in 702us (963us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788620322.248028:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 66 00000100:00100000:0.0:1788620322.251144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620322.251281:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045068544 00000100:00100000:1.0:1788620322.251292:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045068544 00000100:00100000:1.0:1788620322.251401:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 67 00000100:00100000:1.0:1788620322.251412:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+19:12292:x1875504045068544:12345-192.168.201.11@tcp:35:umount.0 00000100:00100000:1.0:1788620322.251779:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:12292:x1875504045068544:12345-192.168.201.11@tcp:35:umount.0 Request processed in 368us (645us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788620322.251787:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 67 00000100:00100000:1.0:1788620322.255016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620322.255609:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045068800 00000100:00100000:3.0:1788620322.255621:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045068800 00000100:00100000:3.0:1788620322.255675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:3.0:1788620322.255684:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cbe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+20:12292:x1875504045068800:12345-192.168.201.11@tcp:35:umount.0 00000100:00100000:3.0:1788620322.256058:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cbe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:12292:x1875504045068800:12345-192.168.201.11@tcp:35:umount.0 Request processed in 374us (1053us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788620322.256064:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 68 00000100:00100000:0.0:1788620322.259196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620322.259285:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045069056 00000100:00100000:3.0:1788620322.259295:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045069056 00000100:00100000:3.0:1788620322.259360:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:3.0:1788620322.259370:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:12292:x1875504045069056:12345-192.168.201.11@tcp:35:umount.0 00000100:00100000:3.0:1788620322.259944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:12292:x1875504045069056:12345-192.168.201.11@tcp:35:umount.0 Request processed in 574us (757us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788620322.259953:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 69 00000100:00100000:0.0:1788620322.270452:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620322.273285:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045069184 00000100:00100000:2.0:1788620322.273302:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045069184 00000100:00100000:2.0:1788620322.273399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:2.0:1788620322.273411:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+13:2355:x1875504045069184:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620322.273429:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620322.273448:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a519e00/0x24857de440bd0497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21ec expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620322.273465:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620322.273524:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:2355:x1875504045069184:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 115us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620322.273531:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:0.0:1788620322.278713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620322.278775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620322.278867:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045069312 00000100:00100000:1.0:1788620322.278878:0:11663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045069312 00000100:00100000:1.0:1788620322.278951:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:1.0:1788620322.278962:0:11663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:2355:x1875504045069312:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620322.278979:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620322.279000:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c549c00/0x24857de440bd045f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21b4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620322.279022:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620322.279076:0:11663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:2355:x1875504045069312:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620322.279084:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:3.0:1788620322.279802:0:12010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045069440 00000100:00100000:3.0:1788620322.279809:0:12010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045069440 00000100:00100000:3.0:1788620322.279857:0:12010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 72 00000100:00100000:3.0:1788620322.279867:0:12010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2352:x1875504045069440:12345-192.168.201.11@tcp:9:umount.0 00000020:00000080:3.0:1788620322.279891:0:12010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd07d1 00000100:00080000:3.0:1788620322.279902:0:12010:0:(import.c:65:import_set_state_nolock()) ffffa0d67a542000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788620322.279945:0:12010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788620322.280204:0:12010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+2:2352:x1875504045069440:12345-192.168.201.11@tcp:9:umount.0 Request processed in 338us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620322.280211:0:12010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 72 00010000:00010000:2.0:1788620322.280286:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620322.280659:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620322.280697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045069568 00000100:00100000:3.0:1788620322.280703:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045069568 00000100:00100000:3.0:1788620322.280741:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:3.0:1788620322.280749:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:2354:x1875504045069568:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620322.280758:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620322.280772:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe3c00/0x24857de440bd070d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22b7 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620322.280784:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620322.280804:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2354:x1875504045069568:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 57us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620322.280825:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:0.0:1788620322.283631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620322.283731:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045069952 00000100:00100000:2.0:1788620322.283741:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045069952 00000100:00100000:2.0:1788620322.283828:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 73 00000100:00100000:2.0:1788620322.283839:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+7:2352:x1875504045069952:12345-192.168.201.11@tcp:9:umount.0 00000020:00000080:2.0:1788620322.283870:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0a32 00000020:00010000:2.0:1788620322.283879:0:6687:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0d649cd1800: total 0 00000100:00080000:2.0:1788620322.283883:0:6687:0:(import.c:65:import_set_state_nolock()) ffffa0d649cd2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788620322.283953:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788620322.284274:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+5:2352:x1875504045069952:12345-192.168.201.11@tcp:9:umount.0 Request processed in 436us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620322.284283:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 73 00000020:00010000:1.0:1788620322.285134:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0d649cd1800: total 0 00010000:00010000:1.0:1788620322.285183:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0d649cd1800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788620322.285240:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004cf3bc1/0x24857de440bd0dd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b248c expref: 4 pid: 7779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620322.285292:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005871b9a3/0x24857de440bd1473 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b265a expref: 3 pid: 12010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620322.285307:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0d649cd1800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788620322.285317:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620322.285320:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620322.285321:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620322.293452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620322.294299:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045070976 00000100:00100000:3.0:1788620322.294312:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045070976 00000100:00100000:3.0:1788620322.294398:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 240 00000100:00100000:3.0:1788620322.294409:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+22:2352:x1875504045070976:12345-192.168.201.11@tcp:39:umount.0 00000020:00000080:3.0:1788620322.294445:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd046d 00000020:00010000:3.0:1788620322.294461:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0d675cad800: total 0 00000100:00080000:3.0:1788620322.294466:0:5840:0:(import.c:65:import_set_state_nolock()) ffffa0d675cae800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788620322.294495:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788620322.294877:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a+21:2352:x1875504045070976:12345-192.168.201.11@tcp:39:umount.0 Request processed in 467us (1431us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788620322.294885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 240 00000020:00010000:0.0:1788620322.295160:0:8448:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0d675cad800: total 0 00010000:00010000:0.0:1788620322.295226:0:8448:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0d675cad800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788620322.295308:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620322.295313:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788620322.295321:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c549800/0x24857de440bd0a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b23b3 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295351:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0d65309e600) 00010000:00010000:0.0:1788620322.295354:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620322.295358:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d680925200/0x24857de440bd0737 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22c5 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295388:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:0.0:1788620322.295391:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788620322.295395:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548600/0x24857de440bd1132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2581 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295408:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620322.295410:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620322.295414:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1354 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b260d expref: 17 pid: 8736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295426:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0d647f7cb00) 00010000:00010000:0.0:1788620322.295428:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788620322.295432:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3200/0x24857de440bd0e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24af expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295447:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620322.295449:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620322.295461:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd0cb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b243f expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295476:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0d647f7cd00) 00010000:00010000:0.0:1788620322.295478:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788620322.295482:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3800/0x24857de440bd07a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22e1 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295495:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d642f43700) 00010000:00010000:0.0:1788620322.295497:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620322.295501:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518e00/0x24857de440bd0753 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22cc expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295513:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620322.295515:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620322.295519:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642600/0x24857de440bd0d96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2477 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295530:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0d647f7c000) 00010000:00010000:0.0:1788620322.295532:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788620322.295535:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd0dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2485 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295548:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620322.295550:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620322.295554:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643200/0x24857de440bd1434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2645 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295567:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:0.0:1788620322.295575:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620322.295580:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d64c548c00/0x24857de440bd0e37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b24a8 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295594:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0d64c7c2500) 00010000:00010000:0.0:1788620322.295596:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788620322.295599:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641642000/0x24857de440bd145e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2653 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620322.295610:0:8448:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0d675cad800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788620322.295623:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620322.295625:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620322.295626:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620322.664602:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620322.664624:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061822976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620322.664706:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620322.664777:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061822976 00000100:00100000:1.0:1788620322.664785:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061822976 00000100:00100000:1.0:1788620322.664856:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788620322.664866:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061822976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788620322.664900:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620322.665215:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061822976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 349us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620322.665223:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788620322.665311:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061822976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620322.665329:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061823360:0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665355:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620322.665375:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620322.665380:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061823488:0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665404:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620322.665419:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061823232:0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665427:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061823104:0@lo:400:kworker.0 00000100:00100000:0.0:1788620322.665448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620322.665450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620322.665469:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d679b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061823616:0@lo:400:kworker.0 00000100:00100000:0.0:1788620322.665480:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061823488 00000100:00100000:0.0:1788620322.665483:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061823488 00000100:00100000:1.0:1788620322.665489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620322.665510:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788620322.665513:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061823104 00000100:00100000:1.0:1788620322.665515:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061823104 00000100:00100000:1.0:1788620322.665537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788620322.665543:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061823104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665583:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061823104:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620322.665599:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788620322.665625:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061823360 00000100:00100000:1.0:1788620322.665628:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061823360 00000100:00100000:1.0:1788620322.665651:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061823232 00000100:00100000:1.0:1788620322.665654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061823232 00000100:00100000:1.0:1788620322.665665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061823616 00000100:00100000:1.0:1788620322.665667:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061823616 00000100:00100000:1.0:1788620322.665682:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788620322.665688:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061823360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665723:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061823360:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620322.665729:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788620322.665742:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788620322.665747:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061823232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665779:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061823232:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620322.665785:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788620322.665787:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061823488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665796:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788620322.665801:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061823616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620322.665819:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061823488:12345-0@lo:400:kworker.0 Request processed in 304us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620322.665820:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061823616:12345-0@lo:400:kworker.0 Request processed in 20us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620322.665826:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788620322.665842:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788620322.665867:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061823232:0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665890:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061823104:0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665898:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d679b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061823616:0@lo:400:kworker.0 00000100:00100000:1.0:1788620322.665945:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061823488:0@lo:400:kworker.0 00000100:00080000:3.0:1788620322.666570:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788620322.666575:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620322.666578:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620322.667242:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061823360:0@lo:400:kworker.0 00000001:00100000:0.0:1788620322.714540:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:0.0:1788620322.714551:0:6712:0:(genops.c:885:class_export_put()) final put ffffa0d649cd1800/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:2.0:1788620322.715572:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d649cd1800/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a for lustre-OST0000 00000020:00000080:2.0:1788620322.715759:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d649cd2800 for lustre-OST0000 00000001:00080000:2.0:1788620322.720422:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:2.0:1788620322.720441:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000001:00080000:2.0:1788620322.720445:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788620322.720466:0:5861:0:(genops.c:885:class_export_put()) final put ffffa0d675cad800/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:3.0:1788620322.720612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d675cad800/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a for lustre-MDT0000 00000020:00000080:3.0:1788620322.721597:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d675cae800 for lustre-MDT0000 00010000:00010000:2.0:1788620323.112699:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620323.177611:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061823744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620323.177700:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620323.177955:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061823744 00000100:00100000:1.0:1788620323.177964:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061823744 00000100:00100000:1.0:1788620323.178024:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788620323.178034:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061823744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620323.178073:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620323.178134:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061823744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620323.178141:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788620323.179541:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061823744:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788620323.817835:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788620323.817846:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620323.823002:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788620323.823017:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788620324.137432:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620324.623189:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620324.623234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620324.623305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620324.623337:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045071104 00000100:00100000:3.0:1788620324.623347:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045071104 00000100:00100000:3.0:1788620324.623396:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045071360 00000100:00100000:3.0:1788620324.623413:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045071360 00000100:00100000:3.0:1788620324.623429:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045071232 00000100:00100000:3.0:1788620324.623432:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045071232 00000100:00100000:3.0:1788620324.623447:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:3.0:1788620324.623456:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+12:2355:x1875504045071104:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620324.623472:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620324.623493:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c549a00/0x24857de440bd053f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2201 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620324.623512:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620324.623775:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:2.0:1788620324.623786:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+11:2355:x1875504045071360:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620324.623795:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620324.623804:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924a00/0x24857de440bd0706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b22b0 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620324.623813:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620324.623858:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+10:2355:x1875504045071360:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 74us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620324.623865:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:2.0:1788620324.623888:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:2.0:1788620324.623895:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+9:2355:x1875504045071232:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620324.623903:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620324.623912:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924e00/0x24857de440bd0546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b222b expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620324.623920:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620324.623938:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+8:2355:x1875504045071232:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 44us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620324.623944:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:3.0:1788620324.624206:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+7:2355:x1875504045071104:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 749us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620324.624214:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:3.0:1788620324.628091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620324.628201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045071616 00000100:00100000:1.0:1788620324.628210:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045071616 00000100:00100000:1.0:1788620324.628288:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 241 00000100:00100000:1.0:1788620324.628297:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+6:2352:x1875504045071616:12345-192.168.201.11@tcp:39:umount.0 00000020:00000080:1.0:1788620324.628342:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0554 00000020:00010000:1.0:1788620324.628349:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0d680a29800: total 0 00000100:00080000:1.0:1788620324.628353:0:5841:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788620324.628378:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788620324.628770:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08800a14-727c-477e-9a55-bbbe86f0530f+5:2352:x1875504045071616:12345-192.168.201.11@tcp:39:umount.0 Request processed in 472us (687us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788620324.628780:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 241 00000100:00080000:3.0:1788620324.628930:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788620324.628973:0:8448:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0d680a29800: total 0 00010000:00010000:0.0:1788620324.628977:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620324.629012:0:8448:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0d680a29800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788620324.629038:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64c7c2300) 00010000:00010000:0.0:1788620324.629040:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620324.629046:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643600/0x24857de440bd1481 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2661 expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620324.629062:0:8448:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0d680a29800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788620324.629068:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620324.629069:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620324.629070:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620324.667353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620324.667480:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045071872 00000100:00100000:3.0:1788620324.667491:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045071872 00000100:00100000:3.0:1788620324.667554:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 300 00000100:00100000:3.0:1788620324.667564:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+7:2352:x1875504045071872:12345-192.168.201.11@tcp:251:umount.0 00000020:00000080:3.0:1788620324.667624:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd044a 00000020:00010000:3.0:1788620324.667633:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0d680a2b800: total 0 00000100:00080000:3.0:1788620324.667637:0:5833:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2e000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788620324.667704:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d14d7bb1-2553-4f3e-b6b5-4e2ce482a163+3:2352:x1875504045071872:12345-192.168.201.11@tcp:251:umount.0 Request processed in 141us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620324.667711:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 300 00000020:00010000:2.0:1788620324.668086:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0d680a2b800: total 0 00010000:00010000:2.0:1788620324.668140:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0d680a2b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788620324.668175:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a518c00/0x24857de440bd049e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b21f3 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620324.668210:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0d680a2b800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788620324.668222:0:5827:0:(genops.c:885:class_export_put()) final put ffffa0d680a2b800/d14d7bb1-2553-4f3e-b6b5-4e2ce482a163 00010000:00010000:2.0:1788620324.668242:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620324.668244:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620324.668246:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788620324.668415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680a2b800/d14d7bb1-2553-4f3e-b6b5-4e2ce482a163 for MGS 00000020:00000080:0.0:1788620324.668459:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d680a2e000 for MGS 00010000:00010000:1.0:1788620325.160598:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788620325.297679:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:3.0:1788620325.297688:0:7638:0:(genops.c:885:class_export_put()) final put ffffa0d67a545000/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a 00000020:00000080:3.0:1788620325.297713:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a545000/6eed8335-35fb-4ef8-8bcd-4d8ba4bbbf3a for lustre-OST0001 00000020:00000080:3.0:1788620325.297762:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67a542000 for lustre-OST0001 00010000:00010000:2.0:1788620326.187620:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788620326.530750:0:12916:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788620326.553526:0:12916:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788620326.553580:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.553596:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.553604:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.553613:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.553642:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788620326.553648:0:12916:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788620326.553676:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788620326.553681:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788620326.553687:0:12916:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788620326.553712:0:12916:0:(import.c:65:import_set_state_nolock()) ffffa0d67a7e5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788620326.553856:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061823872:0@lo:39:umount.0 00000100:00100000:0.0:1788620326.554005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788620326.554141:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620326.554150:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620326.554177:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925600 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620326.554181:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620326.554190:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620326.554198:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620326.554204:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788620326.554207:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788620326.554209:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788620326.554235:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620326.554531:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620326.554567:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620326.554575:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925600/0x24857de440bd04dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620326.554588:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620326.554590:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620326.554592:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620326.554836:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620326.554847:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061824000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620326.555041:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061823872 00000100:00100000:2.0:1788620326.555048:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061823872 00000100:00100000:2.0:1788620326.555109:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788620326.555128:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875504061823872:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788620326.555154:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0259 00000100:00080000:2.0:1788620326.555162:0:5839:0:(import.c:65:import_set_state_nolock()) ffffa0d6465f7000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788620326.555238:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875504061823872:12345-0@lo:39:umount.0 Request processed in 112us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.555355:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620326.555398:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824000 00000100:00100000:0.0:1788620326.555402:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824000 00000100:00100000:0.0:1788620326.555438:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788620326.555445:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3311:x1875504061824000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620326.555455:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620326.555471:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c548200/0x24857de440bd04e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd04dd expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620326.555486:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620326.555522:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:3311:x1875504061824000:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.555530:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788620326.555593:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67a7e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788620326.555605:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061823872:0@lo:39:umount.0 00000100:00100000:0.0:1788620326.555634:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061824000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620326.555815:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620326.555878:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788620326.555956:0:5839:0:(genops.c:885:class_export_put()) final put ffffa0d67a7e7000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788620326.556016:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788620326.556019:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788620326.556024:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788620326.556915:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.556930:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.556937:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.556944:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.556965:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620326.556975:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.556982:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.556988:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557007:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557023:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788620326.557030:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557037:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557043:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557049:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557061:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788620326.557068:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557074:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557080:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557085:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620326.557113:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788620326.557116:0:12916:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788620326.557145:0:12916:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788620326.557150:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788620326.557153:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620326.557159:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1788620326.557165:0:12916:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0d6465f1800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788620326.557171:0:12916:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0d679a80000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788620326.557178:0:12916:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffffa0d680a29800 08800a14-727c-477e-9a55-bbbe86f0530f 192.168.201.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788620326.557183:0:12916:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffffa0d664da0000) has exports, disconnecting them 00000020:00080000:2.0:1788620326.557188:0:12916:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0d6465f1800), last request at 1788620322 00000020:00000080:2.0:1788620326.557195:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd03cc 00000100:00080000:2.0:1788620326.557215:0:12916:0:(import.c:65:import_set_state_nolock()) ffffa0d6465f3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788620326.557292:0:12916:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0d6465f1800): rc 0 00000020:00000080:2.0:1788620326.557295:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d6465f1800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1788620326.557530:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788620326.557537:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557546:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519a00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:3.0:1788620326.557549:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557557:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620326.557564:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620326.557570:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788620326.557573:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788620326.557575:0:8448:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788620326.557606:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557613:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620326.557644:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557653:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d67a519a00/0x24857de440bd04eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557664:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788620326.557668:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557685:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925e00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:3.0:1788620326.557688:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557695:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620326.557701:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620326.557706:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788620326.557708:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788620326.557709:0:8448:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788620326.557722:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557728:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620326.557744:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557751:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925e00/0x24857de440bd0404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd040b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557765:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788620326.557768:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557774:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c548e00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:3.0:1788620326.557777:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557790:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620326.557796:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620326.557801:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788620326.557804:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788620326.557805:0:8448:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788620326.557818:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557823:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620326.557829:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557834:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c548e00/0x24857de440bd06f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd06ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557845:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620326.557848:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557853:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d64c549400 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:3.0:1788620326.557856:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557862:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620326.557878:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620326.557883:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788620326.557885:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788620326.557887:0:8448:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788620326.557900:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557905:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620326.557911:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557916:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d64c549400/0x24857de440bd01b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd01bf expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620326.557926:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620326.557928:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620326.557929:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620326.558678:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061824256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620326.558746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620326.558796:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620326.558802:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061824384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620326.558823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620326.559289:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061824128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620326.559324:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620326.559358:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620326.559364:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061824512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620326.559385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620326.559413:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824256 00000100:00100000:0.0:1788620326.559420:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824256 00000100:00100000:0.0:1788620326.559459:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824384 00000100:00100000:0.0:1788620326.559462:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824384 00000100:00100000:0.0:1788620326.559473:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824128 00000100:00100000:0.0:1788620326.559476:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824128 00000100:00100000:0.0:1788620326.559484:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824512 00000100:00100000:0.0:1788620326.559486:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824512 00000100:00100000:0.0:1788620326.559499:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788620326.559508:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+21:3308:x1875504061824256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620326.559522:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620326.559540:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d640031000/0x24857de440bd040b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd0404 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620326.559558:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620326.559598:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+20:3308:x1875504061824256:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.559619:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788620326.559636:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620326.559642:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+19:3308:x1875504061824384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620326.559650:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620326.559659:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a519200/0x24857de440bd06ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd06f8 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620326.559668:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620326.559691:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+18:3308:x1875504061824384:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.559697:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620326.559710:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620326.559715:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+17:3311:x1875504061824128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620326.559722:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620326.559731:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c549600/0x24857de440bd04f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd04eb expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620326.559740:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620326.559765:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+16:3311:x1875504061824128:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.559771:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620326.559783:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788620326.559789:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+15:3311:x1875504061824512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620326.559796:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620326.559804:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642400/0x24857de440bd01bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd01b8 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620326.559825:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620326.559848:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d645181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e39889e-8996-4811-9fe8-f1c6c0211740+14:3311:x1875504061824512:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.559854:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788620326.559904:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061824384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620326.559914:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061824256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620326.559938:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061824512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620326.559945:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e39889e-8996-4811-9fe8-f1c6c0211740:3311:1875504061824128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788620326.560516:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620326.560523:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788620326.560608:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a7e7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788620326.560674:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d6465f7000 for lustre-MDT0000 00000020:00080000:2.0:1788620326.560804:0:12916:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0d679a80000), last request at 1788620322 00000020:00000080:2.0:1788620326.560812:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0301 00000100:00080000:2.0:1788620326.560821:0:12916:0:(import.c:65:import_set_state_nolock()) ffffa0d679a85000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788620326.560843:0:12916:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0d679a80000): rc 0 00000020:00000080:2.0:1788620326.560845:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d679a80000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788620326.560853:0:12916:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd5301d93ae0 00000100:00080000:2.0:1788620326.560873:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788620326.560877:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788620326.560902:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788620326.560966:0:12916:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788620326.560985:0:12916:0:(import.c:65:import_set_state_nolock()) ffffa0d67fae6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788620326.561004:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788620326.561006:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788620326.561014:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788620326.561071:0:12916:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788620326.561080:0:12916:0:(import.c:65:import_set_state_nolock()) ffffa0d67fae2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788620326.561120:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0d664da0000) has no exports 00000020:00000080:0.0:1788620326.561623:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d6465f1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788620326.561665:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d679a80000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788620326.561689:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d6465f3000 for lustre-MDT0000 00000020:00000080:0.0:1788620326.561695:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d679a85000 for lustre-MDT0000 00000100:00100000:0.0:1788620326.561713:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061824640:0@lo:9:umount.0 00000100:00100000:0.0:1788620326.561773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620326.561812:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061824768:0@lo:9:umount.0 00000100:00100000:0.0:1788620326.561835:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620326.561870:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824640 00000100:00100000:0.0:1788620326.561889:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824640 00000100:00100000:0.0:1788620326.561933:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824768 00000100:00100000:0.0:1788620326.561937:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824768 00000100:00100000:0.0:1788620326.561958:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788620326.561965:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875504061824640:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788620326.561996:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd034e 00000100:00080000:0.0:1788620326.562003:0:6689:0:(import.c:65:import_set_state_nolock()) ffffa0d67fb4d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788620326.562030:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788620326.562565:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3307:x1875504061824640:12345-0@lo:9:umount.0 Request processed in 598us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.562573:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788620326.562589:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788620326.562596:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875504061824768:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788620326.562608:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0435 00000100:00080000:0.0:1788620326.562613:0:6689:0:(import.c:65:import_set_state_nolock()) ffffa0d67a546800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788620326.562633:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788620326.562816:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3307:x1875504061824768:12345-0@lo:9:umount.0 Request processed in 219us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620326.562821:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788620326.562847:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620326.562853:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788620326.563150:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67fae6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788620326.563196:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788620326.563924:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788620326.563934:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061824640:0@lo:9:umount.0 00000100:00080000:0.0:1788620326.563960:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67fae2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788620326.564059:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788620326.564218:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788620326.564223:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061824768:0@lo:9:umount.0 00010000:00010000:1.0:1788620326.564317:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788620326.564550:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620326.564555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1788620326.569983:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0d664da0000) has no exports 00000020:00000080:0.0:1788620326.637563:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0213 00000020:00000080:0.0:1788620326.637592:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d659248800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788620326.637615:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788620326.637660:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d659248800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788620326.644146:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620326.644164:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788620326.644170:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffffa0d681a099b8) has no exports 00000020:00000080:1.0:1788620326.644642:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd020c 00000020:00000080:1.0:1788620326.644652:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d664cd1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788620326.644718:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788620326.644726:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788620326.644730:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d680385000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788620326.644732:0:12916:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680385000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788620326.644742:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788620326.644921:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d664cd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788620327.208605:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620327.789561:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620327.789589:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061824896:0@lo:400:kworker.0 00000100:00100000:1.0:1788620327.789655:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620327.789902:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061825024:0@lo:400:kworker.0 00000100:00100000:0.0:1788620327.789945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620327.789981:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620327.789983:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061825024 00000100:00100000:0.0:1788620327.789990:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061825152:0@lo:400:kworker.0 00000100:00100000:1.0:1788620327.789992:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061825024 00000100:00100000:0.0:1788620327.790024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620327.790299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061824896 00000100:00100000:3.0:1788620327.790304:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061824896 00000100:00100000:3.0:1788620327.790338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788620327.790356:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:3310:x1875504061824896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620327.790417:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e39889e-8996-4811-9fe8-f1c6c0211740+14:3310:x1875504061824896:12345-0@lo:400:kworker.0 Request processed in 62us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620327.790424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788620327.790635:0:8736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061825152 00000100:00100000:1.0:1788620327.790639:0:8736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061825152 00000100:00100000:1.0:1788620327.790682:0:8736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788620327.790687:0:8736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875504061825024:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788620327.790694:0:8736:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788620327.790746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788620327.790753:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875504061825152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788620327.790761:0:5839:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788620327.790803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875504061825152:12345-0@lo:400:kworker.0 Request processed in 48us (779us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788620327.790810:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788620327.790869:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061824896:0@lo:400:kworker.0 00000100:00100000:1.0:1788620327.790945:0:8736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875504061825024:12345-0@lo:400:kworker.0 Request processed in 256us (1000us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788620327.790952:0:8736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1788620327.790987:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788620327.790993:0:3308:0:(import.c:65:import_set_state_nolock()) ffffa0d67a544800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788620327.790997:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788620327.809347:0:3308:0:(import.c:65:import_set_state_nolock()) ffffa0d67a544800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788620327.809363:0:3308:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 195 00000100:00080000:1.0:1788620327.809383:0:3308:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0d67a544800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:1.0:1788620327.809548:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d680390380 x1875504061825280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620327.809576:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061825152:0@lo:400:kworker.0 00000100:00100000:1.0:1788620327.809592:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061825280:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788620327.809662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620327.809709:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061825280 00000100:00100000:2.0:1788620327.809718:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061825280 00000100:00080000:1.0:1788620327.809750:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788620327.809756:0:3308:0:(import.c:65:import_set_state_nolock()) ffffa0d67fb4a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788620327.809760:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788620327.809765:0:3308:0:(import.c:65:import_set_state_nolock()) ffffa0d67fb4a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788620327.809766:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788620327.809775:0:3308:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 179 00000100:00100000:2.0:1788620327.809780:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061825280:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788620327.809794:0:3308:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0d67fb4a000 using connection 192.168.201.111@tcp/0@lo 00010000:02000000:2.0:1788620327.809799:0:5839:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788620327.809820:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d680391500 x1875504061825408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620327.809836:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061825024:0@lo:400:kworker.0 00000100:00100000:1.0:1788620327.809862:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875504061825408:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788620327.809888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620327.809918:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061825408 00000100:00100000:1.0:1788620327.809922:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061825408 00000100:00100000:1.0:1788620327.809945:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788620327.809950:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875504061825408:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788620327.809959:0:5841:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788620327.809996:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875504061825408:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 44us (107us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788620327.810009:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788620327.810038:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67fb4a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620327.810042:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788620327.810045:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875504061825408:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788620327.819127:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061825280:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 9340us (9457us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788620327.819144:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788620327.819197:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d67a544800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788620327.819202:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788620327.819207:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061825280:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1788620327.849113:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788620327.849124:0:6712:0:(genops.c:885:class_export_put()) final put ffffa0d67fb4c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788620327.849152:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67fb4c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788620327.849194:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67fb4d000 for lustre-OST0000 00000001:00100000:1.0:1788620327.888152:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08800a14-727c-477e-9a55-bbbe86f0530f 00000001:00080000:1.0:1788620327.888171:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788620327.888177:0:5861:0:(genops.c:885:class_export_put()) final put ffffa0d680a29800/08800a14-727c-477e-9a55-bbbe86f0530f 00000020:00000080:0.0:1788620327.888541:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680a29800/08800a14-727c-477e-9a55-bbbe86f0530f for lustre-MDT0000 00000020:00000080:0.0:1788620327.888797:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d680a2a800 for lustre-MDT0000 00010000:00010000:0.0:1788620328.232943:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788620328.680506:0:12916:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d6467cacc0 - data ffffa0d67fcf01b0/ffffa0d65078c000 00000020:01000000:1.0:1788620328.680637:0:12916:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d6589d48a0 - data ffffa0d66dd6e798/ffffa0d6508cf400 00000001:00000004:1.0:1788620328.686881:0:12916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788620328.783469:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788620328.783478:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788620328.783536:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788620328.783539:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788620328.785310:0:7159:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788620328.785318:0:7159:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788620328.785328:0:7159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788620328.789643:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788620328.789651:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788620328.789661:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788620328.789664:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788620328.790068:0:7777:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788620328.790074:0:7777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788620328.790086:0:7777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788620328.848274:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd01db 00000020:00000080:3.0:1788620328.848286:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d67a7e7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788620328.849418:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd01f0 00000020:00000080:3.0:1788620328.849426:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d680c09000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788620328.849432:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788620328.849437:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620328.849446:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788620328.849450:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffffa0d664da3370) has no exports 00000004:01000000:3.0:1788620328.849609:0:12916:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788620328.849618:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd042e 00000020:00000080:3.0:1788620328.849622:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d65924d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788620328.849626:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788620328.849630:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620328.849636:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788620328.849639:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffffa0d650643370) has no exports 00000020:00000080:3.0:1788620328.849645:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0427 00000020:00000080:3.0:1788620328.849647:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d67fae0000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788620328.849973:0:12916:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788620328.849977:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788620328.849981:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788620328.849987:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788620328.849989:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788620328.850020:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620328.850027:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788620328.850038:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0347 00000020:00000080:3.0:1788620328.850043:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d666f4b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788620328.850048:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788620328.850051:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620328.850055:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788620328.850071:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa0d681a0b370) has no exports 00000020:00000080:3.0:1788620328.850076:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0340 00000020:00000080:3.0:1788620328.850079:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d67fae3800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788620328.850411:0:12916:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788620328.850415:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788620328.850417:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788620328.850421:0:12916:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788620328.850422:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788620328.850446:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620328.850452:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788620328.850478:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620328.850481:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788620328.850506:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd01f7 00000020:00000080:3.0:1788620328.850510:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d680c0d800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788620328.850515:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788620328.850518:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620328.850521:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788620328.850523:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffffa0d664da19b8) has no exports 00000020:00000080:3.0:1788620328.850543:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620328.850546:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788620328.850549:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd01fe 00000020:00000080:3.0:1788620328.850551:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d680c0f000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788620328.850557:0:12916:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d649f43000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788620328.850560:0:12916:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d649f43000 3 00000020:01000004:3.0:1788620328.850563:0:12916:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0d649f43000 from lustre-MDT0000 00000020:00000080:3.0:1788620328.850580:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620328.850583:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788620328.850592:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d67a7e2800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788620328.850595:0:12916:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a7e2800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788620328.850603:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788620328.850656:0:12916:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788620328.850660:0:12916:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788620328.850663:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788620328.850665:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620328.850668:0:12916:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788620328.850675:0:12916:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffffa0d65141f000 4e39889e-8996-4811-9fe8-f1c6c0211740 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788620328.850680:0:12916:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffffa0d64501cd28) has exports, disconnecting them 00000020:00080000:3.0:1788620328.850684:0:12916:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa0d65141f000), last request at 1788620113 00000020:00000080:3.0:1788620328.850697:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd019c 00000020:00010000:3.0:1788620328.850701:0:12916:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0d65141f000: total 8 00000100:00080000:3.0:1788620328.850705:0:12916:0:(import.c:65:import_set_state_nolock()) ffffa0d65141d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788620328.850727:0:12916:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0d65141f000): rc 0 00000020:00080000:3.0:1788620328.850731:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffffa0d64501cd28) has no exports 00000100:00100000:3.0:1788620328.850794:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0d649f59000:5834] 2 exiting: rc = 0 00000100:00100000:1.0:1788620328.851403:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa0d666e9cc00:5832] 0 exiting: rc = 1 00000020:00000080:1.0:1788620328.851449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a7e7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788620328.851455:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680c09000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788620328.851471:0:36:0:(genops.c:885:class_export_put()) final put ffffa0d67a7e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788620328.851473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a7e2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788620328.851478:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620328.851587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d65924d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788620328.851593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67fae0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788620328.851597:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67fae2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788620328.851602:0:36:0:(genops.c:885:class_export_put()) final put ffffa0d675caa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788620328.851604:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d675caa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788620328.851607:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620328.851631:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d666f4b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788620328.851646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67fae3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788620328.851649:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67fae6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788620328.851652:0:36:0:(genops.c:885:class_export_put()) final put ffffa0d67fae4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788620328.851654:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67fae4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788620328.851657:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620328.851709:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680c0d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788620328.851712:0:36:0:(genops.c:885:class_export_put()) final put ffffa0d680c0e800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788620328.851714:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680c0e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788620328.851717:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788620328.851840:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680c0f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788620328.851966:0:8448:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0d65141f000: total 0 00010000:00010000:0.0:1788620328.851996:0:8448:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0d65141f000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788620328.852025:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d680924800/0x24857de440bd0500 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd04f9 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852043:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe3600/0x24857de440bd04ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd04b3 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852054:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c548a00/0x24857de440bd04ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd04a5 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852087:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a518a00/0x24857de440bd06e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd06dc expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852098:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a518600/0x24857de440bd04c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd04c1 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852108:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2800/0x24857de440bd04d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd04cf expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852122:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641510e00/0x24857de440bd02b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd02ad expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852139:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d64c548000/0x24857de440bd06f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24857de440bd06ea expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620328.852149:0:8448:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0d65141f000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788620328.852173:0:8448:0:(genops.c:885:class_export_put()) final put ffffa0d65141f000/4e39889e-8996-4811-9fe8-f1c6c0211740 00010000:00010000:0.0:1788620328.852189:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620328.852191:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620328.852193:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788620328.852325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d65141f000/4e39889e-8996-4811-9fe8-f1c6c0211740 for MGS 00000020:00000080:1.0:1788620328.852355:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d65141d800 for MGS 00000100:00100000:2.0:1788620328.852524:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa0d6581c6400:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1788620328.852883:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852890:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852896:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852902:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852907:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852913:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852920:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852926:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852940:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852946:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852951:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852957:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852964:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852969:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852974:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.852988:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853000:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853005:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853011:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853017:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853021:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853027:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853033:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853038:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853044:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853049:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853065:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853072:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853077:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853083:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853088:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853094:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853099:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853105:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853110:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853115:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853120:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853124:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853129:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853135:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853140:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853145:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853218:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853227:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853232:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853237:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.853242:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856166:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856189:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856196:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856218:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856225:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856230:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856235:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856240:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856804:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856817:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856826:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856831:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856837:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856843:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856849:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856855:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.856860:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788620328.857731:0:12916:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788620328.857735:0:12916:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788620328.858419:0:12916:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d675ce6cc0 - data ffffa0d67fe83510/ffffa0d67a615c00 00000020:01000000:3.0:1788620328.858530:0:12916:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d66a69d300 - data ffffa0d65dc22438/ffffa0d664c83000 00000020:00000080:3.0:1788620328.858982:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0180 00000020:00000080:3.0:1788620328.858990:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d66a6c9000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788620328.859102:0:12916:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d649f43000 from MGS, refs=2 00000020:01000004:3.0:1788620328.859106:0:12916:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d649f43000 2 00000020:01000004:3.0:1788620328.859110:0:12916:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0d649f43000 from MGS 00000020:00000080:3.0:1788620328.859134:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620328.859140:0:12916:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788620328.859143:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d66a6ca800/MGS 00000020:00000080:3.0:1788620328.859146:0:12916:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d66a6ca800/MGS for MGS 00000020:01000000:3.0:1788620328.859152:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788620328.859204:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788620328.859208:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620328.859214:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788620328.859220:0:12916:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa0d664dc1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788620328.859226:0:12916:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffffa0d679b98000) has exports, disconnecting them 00000020:00080000:3.0:1788620328.859240:0:12916:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa0d664dc1800), last request at 1788620114 00000020:00000080:3.0:1788620328.859245:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd024b 00000020:00080000:3.0:1788620328.859395:0:12916:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0d664dc1800): rc 0 00000020:00000080:3.0:1788620328.859400:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d664dc1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788620328.860065:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d66a6c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788620328.860081:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d664dc1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788620328.879296:0:12916:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788620328.879306:0:12916:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788620328.879310:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788620328.879322:0:12916:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788620328.879364:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67a7e5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788620328.879495:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620328.879505:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788620328.879511:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d680c0d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788620328.879526:0:12916:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d680c0d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788620328.879535:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788620328.879590:0:12916:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d649f43000 1 00000020:00000080:0.0:1788620328.879596:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd0172 00000020:00000080:0.0:1788620328.879602:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d66a6c9800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788620328.879617:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788620328.879621:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620328.879625:0:12916:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788620328.879629:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffffa0d6450199b8) has no exports 00000020:00000080:1.0:1788620328.879776:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d66a6c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788620328.927486:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620328.927501:0:12916:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788620328.927508:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d658923000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788620328.927512:0:12916:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d658923000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788620328.927522:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788620328.927654:0:12916:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0d658920000 00000020:01000000:2.0:1788620328.927678:0:12916:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788620328.927683:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620328.927688:0:12916:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788620328.927692:0:12916:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffffa0d664e119b8) has no exports 00000100:00100000:1.0:1788620328.931052:0:8736:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa0d542bee600:8736] 3 exiting: rc = 0 00000100:00100000:1.0:1788620328.931579:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa0d6580b2800:5841] 2 exiting: rc = 0 00000100:00100000:1.0:1788620328.931829:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa0d666e9d400:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1788620328.934657:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa0d6451c4800:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1788620328.935009:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935018:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935023:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935029:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935034:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935040:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935046:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935051:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935110:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935118:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935123:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935129:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935135:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935140:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935210:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935220:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935225:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935230:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935236:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935242:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935280:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935287:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935292:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935297:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935318:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935323:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935329:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935336:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935341:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935347:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935353:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935358:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935364:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935370:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935375:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935381:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935386:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935392:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935397:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935403:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935407:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935413:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935417:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935436:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935444:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935450:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935455:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935461:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935466:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935717:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935727:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935732:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935737:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935742:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935747:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935752:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935757:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935762:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935767:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935781:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935787:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935792:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935798:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.935803:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.942493:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa0d6580b2600:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788620328.942824:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa0d664e24200:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1788620328.943119:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943128:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943134:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943138:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943160:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943166:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943177:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943183:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943189:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943195:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943200:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943206:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943212:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943217:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943222:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943226:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943231:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943236:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943241:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943367:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943375:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943381:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943386:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943391:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943396:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943402:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943407:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943416:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943422:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943427:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943445:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943451:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943457:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943464:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943480:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943486:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943491:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943496:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943501:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943507:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943512:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943518:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943522:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943528:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943533:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943539:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943545:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943550:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943556:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943561:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943566:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943572:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943577:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.943583:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944321:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944327:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944332:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944337:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944342:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944347:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944352:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944358:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944362:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.944367:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.945086:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa0d66980ac00:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1788620328.945541:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa0d66980a600:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788620328.945801:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945818:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945825:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945831:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945837:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945913:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945919:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945926:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945933:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945939:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945944:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945950:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945973:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945980:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945986:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945992:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.945998:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946003:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946008:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946014:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946020:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946026:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946032:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946038:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946070:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946077:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946082:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946088:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946095:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946100:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946106:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946112:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946118:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946124:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946130:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946136:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946233:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946240:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946349:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946358:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946368:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946374:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946385:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946392:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946399:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946405:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946411:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946418:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946440:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946446:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946452:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946458:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946465:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946534:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946544:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946550:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946557:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946563:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946569:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946575:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946665:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946672:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946679:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.946685:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620328.958823:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa0d664e25200:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1788620328.958994:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa0d664e25800:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1788620328.959103:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959110:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959115:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959120:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959125:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959130:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959135:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959139:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959144:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959216:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959223:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959229:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959234:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959239:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959245:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959571:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959577:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959582:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959598:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959604:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959609:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959614:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959618:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959623:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959628:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959633:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959638:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959655:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959660:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959666:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959671:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959676:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959681:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959687:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959693:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959698:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959703:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959708:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959715:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959720:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959726:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959731:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959736:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959741:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959746:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959751:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959756:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959761:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959766:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959771:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959776:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959781:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959786:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959791:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959796:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959801:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959806:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959811:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959816:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959821:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959826:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.959830:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.960039:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.960046:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620328.961080:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa0d667914000:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1788620328.961604:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa0d664e24a00:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1788620328.961916:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961923:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961928:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961933:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961937:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961943:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961948:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961953:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961958:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961963:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961968:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961974:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961979:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961984:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961989:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.961995:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962000:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962005:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962010:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962014:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962020:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962026:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962031:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962036:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962042:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962047:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962052:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962069:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962075:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962080:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962085:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962091:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962096:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962113:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962119:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962124:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962129:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962134:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962140:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962145:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962228:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962234:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962239:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962245:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962465:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962537:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962544:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962550:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962555:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962561:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962565:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962570:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962575:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962580:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962654:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962662:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962667:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962673:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962678:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962683:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962688:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962694:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962699:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.962704:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620328.963965:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa0d667915200:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1788620328.964080:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa0d667915800:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1788620328.964939:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964948:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964953:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964957:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964974:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964980:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964985:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964990:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.964995:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965000:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965005:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965011:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965016:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965022:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965027:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965032:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965038:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965043:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965048:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965063:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965069:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965074:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965080:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965085:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965091:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965096:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965102:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965108:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965113:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965119:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965125:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965130:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965135:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965140:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965145:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965161:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965165:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965171:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965176:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965188:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965193:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965198:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965203:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965208:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965214:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965219:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965225:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965230:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965234:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965240:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965245:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965273:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965278:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965283:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965289:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965294:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965299:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965304:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965310:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965315:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965320:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965326:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965331:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.965336:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620328.966520:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa0d664d9ac00:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1788620328.967021:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa0d664d9a600:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1788620328.967465:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa0d667999c00:5854] 2 exiting: rc = 0 00000100:00100000:3.0:1788620328.967605:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967613:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967618:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967624:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967630:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967637:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967642:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967648:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967662:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967668:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967674:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967680:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967685:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967691:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967696:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967701:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967707:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967712:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967717:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967722:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967728:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967734:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967739:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967744:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967749:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967755:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967760:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967766:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967772:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967790:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967797:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967803:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967808:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967812:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967818:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967824:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967828:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967834:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967959:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967968:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967973:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967979:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967984:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.967996:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968002:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968008:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968013:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968019:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968024:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968029:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968035:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968040:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968046:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968108:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968115:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968120:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968125:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968131:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968136:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968141:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968202:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968210:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968216:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620328.968223:0:12916:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788620328.974991:0:12916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620328.975004:0:12916:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788620328.975010:0:12916:0:(genops.c:885:class_export_put()) final put ffffa0d664dc4800/MDS_uuid 00000020:00000080:3.0:1788620328.975014:0:12916:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d664dc4800/MDS_uuid for MDS 00000020:01000000:3.0:1788620328.975020:0:12916:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788620328.975221:0:12916:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788620329.256757:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620330.280531:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788620330.390636:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788620330.390646:0:7638:0:(genops.c:885:class_export_put()) final put ffffa0d67a543000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788620330.390901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a543000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788620330.390951:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67a546800 for lustre-OST0001 00010000:00010000:0.0:1788620331.307088:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788620331.729127:0:13068:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788620331.759902:0:13068:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788620331.759969:0:13068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620331.759989:0:13068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620331.760031:0:13068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620331.760038:0:13068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620331.760070:0:13068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788620331.760078:0:13068:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788620331.760107:0:13068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788620331.760113:0:13068:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788620331.760121:0:13068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788620331.760129:0:13068:0:(import.c:65:import_set_state_nolock()) ffffa0d67fb4a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788620331.760135:0:13068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788620331.760137:0:13068:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788620331.760141:0:13068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788620331.762803:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620331.762824:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620331.762841:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2000 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620331.762847:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620331.762861:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620331.762870:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620331.762877:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788620331.762902:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788620331.762907:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788620331.762965:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620331.762973:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788620331.763026:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620331.763035:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd04c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620331.763054:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620331.763056:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620331.763058:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620331.763114:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061825536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620331.763330:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620331.763402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061825536 00000100:00100000:3.0:1788620331.763419:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061825536 00000100:00100000:3.0:1788620331.763489:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788620331.763499:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1875504061825536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788620331.763508:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788620331 with bad export cookie 2631647976560066972 00010000:00010000:2.0:1788620331.763604:0:13068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763631:0:13068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763640:0:13068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763647:0:13068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763668:0:13068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620331.763675:0:13068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763683:0:13068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763690:0:13068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763698:0:13068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763712:0:13068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788620331.763716:0:13068:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788620331.763747:0:13068:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788620331.763753:0:13068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1788620331.763763:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620331.763769:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763787:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925a00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620331.763791:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763799:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620331.763806:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620331.763812:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620331.763814:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788620331.763816:0:8448:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788620331.763833:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763839:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620331.763852:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763859:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925a00/0x24857de440bd04cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd04d6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763873:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620331.763876:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763882:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519600 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620331.763885:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763898:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620331.763905:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620331.763910:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788620331.763912:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788620331.763914:0:8448:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788620331.763931:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763938:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620331.763956:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763963:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d67a519600/0x24857de440bd06ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24857de440bd06f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620331.763973:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620331.763974:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620331.763976:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788620331.763987:0:13068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620331.763996:0:13068:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788620331.764001:0:13068:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0d681a0cd28) has no exports 00000020:00080000:2.0:1788620331.764047:0:13068:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0d681a0cd28) has no exports 00000100:00100000:1.0:1788620331.764687:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620331.764707:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061825664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620331.764781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788620331.764843:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620331.764854:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061825792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620331.764882:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620331.764915:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061825664 00000100:00100000:1.0:1788620331.764924:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061825664 00000100:00100000:1.0:1788620331.764950:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061825792 00000100:00100000:1.0:1788620331.764962:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061825792 00000100:00100000:1.0:1788620331.764980:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788620331.764988:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1875504061825664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788620331.764995:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788620331 with bad export cookie 2631647976560066972 00000100:00100000:1.0:1788620331.765122:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1875504061825664:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (340us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788620331.765131:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788620331.765151:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788620331.765169:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6514be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875504061825792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788620331.765173:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788620331 with bad export cookie 2631647976560066972 00000100:00100000:1.0:1788620331.765204:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6514be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875504061825792:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (321us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788620331.765210:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788620331.765245:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788620331.765270:0:3308:0:(import.c:65:import_set_state_nolock()) ffffa0d670298800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788620331.765276:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788620331.767385:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:2.0:1788620331.768144:0:13068:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d644d1b2a0 - data ffffa0d67fdf1798/ffffa0d675cbdc00 00000020:01000000:2.0:1788620331.768841:0:13068:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d64364cd80 - data ffffa0d67fc20438/ffffa0d541142c00 00000100:00080000:1.0:1788620331.789051:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788620331.789059:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788620331.789072:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0d6804ab480 x1875504061825536/t0(0) o103->MGC192.168.201.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788620347 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620331.789089:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0d6807dc700 x1875504061825664/t0(0) o103->MGC192.168.201.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788620347 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620331.789099:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0d6807dce00 x1875504061825792/t0(0) o103->MGC192.168.201.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788620347 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788620331.789109:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788620331.789113:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788620331.789115:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788620331.789699:0:3310:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffffa0d670298800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788620331.789737:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061825536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620331.789774:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e39889e-8996-4811-9fe8-f1c6c0211740:3310:1875504061825664:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788620331.792451:0:3308:0:(import.c:65:import_set_state_nolock()) ffffa0d670298800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788620331.792468:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.201.111@tcp: connect to NID 0@lo last attempt 163 00000100:00080000:1.0:1788620331.792480:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.201.111@tcp: import ffffa0d670298800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:1.0:1788620331.792597:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d680390e00 x1875504061825920/t0(0) o250->MGC192.168.201.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788620331.792683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e39889e-8996-4811-9fe8-f1c6c0211740:3307:1875504061825920:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788620331.792793:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875504061825920 offset 0 length 520: 4 00000100:00100000:1.0:1788620331.793063:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e39889e-8996-4811-9fe8-f1c6c0211740:3308:1875504061825792:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1788620331.794783:0:5825:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875504061825536 offset 224 length 224: 4 00000100:00100000:3.0:1788620331.795081:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1875504061825536:12345-0@lo:103:ldlm_bl.0 Request processed in 31580us (31750us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788620331.795094:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00100000:10000000:3.0:1788620331.818308:0:13068:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788620331.869681:0:13068:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd02d0 00000020:00000080:1.0:1788620331.869692:0:13068:0:(genops.c:885:class_export_put()) final put ffffa0d6465f4000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788620331.870528:0:13068:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d680c0a000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788620331.870538:0:13068:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d680c0a000 2 00000020:01000004:1.0:1788620331.870542:0:13068:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0d680c0a000 from lustre-OST0000 00000020:00000080:1.0:1788620331.870582:0:13068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788620331.870595:0:13068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788620331.870599:0:13068:0:(genops.c:885:class_export_put()) final put ffffa0d648500000/lustre-OST0000_UUID 00000020:00000080:1.0:1788620331.870603:0:13068:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d648500000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788620331.870612:0:13068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788620331.870680:0:13068:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788620331.870685:0:13068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788620331.870690:0:13068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620331.870696:0:13068:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788620331.870705:0:13068:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa0d67fb4e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788620331.870711:0:13068:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffffa0d679b999b8) has exports, disconnecting them 00000020:00080000:1.0:1788620331.870718:0:13068:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa0d67fb4e000), last request at 1788620129 00000020:00000080:1.0:1788620331.870724:0:13068:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd02fa 00000020:00080000:1.0:1788620331.870739:0:13068:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0d67fb4e000): rc 0 00000020:00000080:1.0:1788620331.870745:0:13068:0:(genops.c:885:class_export_put()) final put ffffa0d67fb4e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788620331.870979:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d6465f4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788620331.872293:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67fb4e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788620331.881368:0:13068:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788620331.881379:0:13068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788620331.881385:0:13068:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788620331.881394:0:13068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788620331.881427:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67fb4a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788620331.881636:0:13068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620331.881646:0:13068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788620331.881652:0:13068:0:(genops.c:885:class_export_put()) final put ffffa0d67fb4d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788620331.881670:0:13068:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67fb4d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788620331.881676:0:13068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788620331.881743:0:13068:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d680c0a000 1 00000020:00000080:0.0:1788620331.881749:0:13068:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd028a 00000020:00000080:0.0:1788620331.881757:0:13068:0:(genops.c:885:class_export_put()) final put ffffa0d664dc7000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788620331.881765:0:13068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788620331.881772:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d664dc7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788620331.881780:0:13068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620331.881785:0:13068:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788620331.881801:0:13068:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffffa0d664e14d28) has no exports 00000020:00000080:0.0:1788620331.899896:0:13068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620331.899920:0:13068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788620331.899928:0:13068:0:(genops.c:885:class_export_put()) final put ffffa0d664dc2800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788620331.899934:0:13068:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d664dc2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788620331.899947:0:13068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788620331.900187:0:13068:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0d6679a3800 00000020:02000400:0.0:1788620331.900269:0:13068:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788620332.333560:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788620332.906663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4e39889e-8996-4811-9fe8-f1c6c0211740->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788620332.906673:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4e39889e-8996-4811-9fe8-f1c6c0211740->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788620332.906677:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788620332.906680:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788620332.906685:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0d67a544800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788620332.906695:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 377 00000100:00080000:2.0:1788620332.906701:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788620332.906709:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0d67a544800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:2.0:1788620332.906749:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6807df100 x1875504061826048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620332.906924:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061826048:0@lo:38:kworker.0 00000400:00000100:1.0:1788620332.906978:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875504061826048 offset 0 length 520: 4 00010000:00010000:2.0:1788620333.352429:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620334.378555:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788620334.566397:0:13217:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788620334.587459:0:13217:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788620334.587610:0:13217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620334.587626:0:13217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620334.587634:0:13217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620334.587640:0:13217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620334.587657:0:13217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788620334.587663:0:13217:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788620334.587685:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620334.587696:0:13217:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0d6807df100 x1875504061826048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788620347 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620334.587712:0:13217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788620334.587718:0:13217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788620334.587724:0:13217:0:(import.c:65:import_set_state_nolock()) ffffa0d67a544800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788620334.587728:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620334.587732:0:13217:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0d6807df100 x1875504061826048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788620347 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620334.587763:0:13217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788620334.587767:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1788620334.588218:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620334.588226:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.588234:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925000 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620334.588238:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620334.588346:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061826048:0@lo:38:kworker.0 00010000:00010000:2.0:1788620334.588397:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620334.588407:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620334.588425:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620334.588428:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788620334.588430:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788620334.588443:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0d670298800 00010000:00010000:2.0:1788620334.588447:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.588454:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925000/0x24857de440bd04a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd04ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.588465:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620334.588467:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620334.588468:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620334.590019:0:13217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.590038:0:13217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.590045:0:13217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.590051:0:13217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.590117:0:13217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620334.590125:0:13217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.590147:0:13217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.590153:0:13217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.590159:0:13217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590186:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620334.590193:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590200:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519400 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620334.590203:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590211:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620334.590218:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620334.590234:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788620334.590236:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788620334.590245:0:8448:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0d670298800 00010000:00010000:0.0:1788620334.590287:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590294:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d67a519400/0x24857de440bd04b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd04ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590306:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620334.590310:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590316:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d680925400 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:0.0:1788620334.590319:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590325:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788620334.590332:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620334.590337:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788620334.590339:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788620334.590343:0:8448:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0d670298800 00010000:00010000:0.0:1788620334.590346:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620334.590362:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620334.590363:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620334.590365:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620334.590689:0:13217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788620334.590694:0:13217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680925400/0x24857de440bd06dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd06e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620334.590705:0:13217:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788620334.590710:0:13217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788620334.590712:0:13217:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788620334.590735:0:13217:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788620334.590751:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788620334.591166:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620334.591174:0:13217:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788620334.591179:0:13217:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa0d681a08000) has no exports 00000020:00080000:2.0:1788620334.591205:0:13217:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa0d681a08000) has no exports 00010000:00010000:0.0:1788620334.593593:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788620334.593963:0:13217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d675ce6300 - data ffffa0d67fe83a20/ffffa0d67a616000 00000020:01000000:2.0:1788620334.594143:0:13217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0d658886420 - data ffffa0d65de50288/ffffa0d542800800 00100000:10000000:0.0:1788620334.610480:0:13217:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788620334.641107:0:13217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd039b 00000020:00000080:2.0:1788620334.641118:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d666f48000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788620334.641139:0:13217:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d675d13000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788620334.641144:0:13217:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d675d13000 2 00000020:01000004:2.0:1788620334.641147:0:13217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0d675d13000 from lustre-OST0001 00000020:00000080:2.0:1788620334.641187:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620334.641198:0:13217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788620334.641201:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d65924a800/lustre-OST0001_UUID 00000020:00000080:2.0:1788620334.641203:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d65924a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788620334.641209:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788620334.641357:0:13217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4e39889e-8996-4811-9fe8-f1c6c0211740->MGS 00010000:00010000:2.0:1788620334.641371:0:13217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd02b4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620334.641383:0:13217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd02b4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620334.641391:0:13217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788620334.641393:0:13217:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788620334.641396:0:13217:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788620334.641412:0:13217:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0d670298800 00010000:00010000:2.0:1788620334.641415:0:13217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641511c00/0x24857de440bd02ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd02b4 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620334.641433:0:13217:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24857de440bd0500 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620334.641439:0:13217:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24857de440bd0500 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620334.641444:0:13217:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620334.641446:0:13217:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788620334.641447:0:13217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788620334.641455:0:13217:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0d670298800 00010000:00010000:2.0:1788620334.641457:0:13217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d680924000/0x24857de440bd04f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24857de440bd0500 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788620334.641484:0:13217:0:(import.c:65:import_set_state_nolock()) ffffa0d670298800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788620334.641704:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788620334.641706:0:13217:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788620334.641708:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788620334.641711:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788620334.641722:0:13217:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0d680390e00 x1875504061825920/t0(0) o250->MGC192.168.201.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788620341 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788620334.641750:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788620334.641753:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1788620334.641859:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d666f48000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788620334.641922:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e39889e-8996-4811-9fe8-f1c6c0211740:3307:1875504061825920:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1788620334.641990:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788620334.641998:0:13217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd018e 00000020:00000080:2.0:1788620334.642003:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d664dc0800/4e39889e-8996-4811-9fe8-f1c6c0211740 00000020:01000000:2.0:1788620334.642017:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.111@tcp (flags='') 00000020:00000080:2.0:1788620334.642022:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620334.642027:0:13217:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788620334.642030:0:13217:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffffa0d664da4d28) has no exports 00000020:00000080:3.0:1788620334.642088:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d664dc0800/4e39889e-8996-4811-9fe8-f1c6c0211740 for MGC192.168.201.111@tcp 10000000:01000000:0.0:1788620334.648202:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788620334.648417:0:13217:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.111@tcp: client import never connected 00000100:00080000:2.0:1788620334.648424:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788620334.648429:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788620334.648432:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788620334.648436:0:13217:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788620334.648501:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620334.648511:0:13217:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.111@tcp (uuid 4e39889e-8996-4811-9fe8-f1c6c0211740) 00000020:01000000:2.0:1788620334.648521:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788620334.648529:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620334.648535:0:13217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788620334.648542:0:13217:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa0d67a540000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788620334.648549:0:13217:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffffa0d679b9cd28) has exports, disconnecting them 00000020:00080000:2.0:1788620334.648554:0:13217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa0d67a540000), last request at 1788620145 00000020:00000080:2.0:1788620334.648559:0:13217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd03c5 00000020:00080000:2.0:1788620334.648593:0:13217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0d67a540000): rc 0 00000020:00000080:2.0:1788620334.648598:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d67a540000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788620334.649646:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d670298800 for MGC192.168.201.111@tcp 00000020:00000080:0.0:1788620334.649659:0:38:0:(genops.c:885:class_export_put()) final put ffffa0d67029e800/4e39889e-8996-4811-9fe8-f1c6c0211740 00000020:00000080:0.0:1788620334.649662:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67029e800/4e39889e-8996-4811-9fe8-f1c6c0211740 for MGC192.168.201.111@tcp 00000020:01000000:0.0:1788620334.649670:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.111@tcp (4e39889e-8996-4811-9fe8-f1c6c0211740) 00000020:00000080:0.0:1788620334.649920:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a540000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788620334.656349:0:13217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788620334.656358:0:13217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620334.656362:0:13217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788620334.656369:0:13217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788620334.656431:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788620334.656574:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1788620334.656676:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0d67a544800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788620334.656870:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788620334.657018:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa0d666e8d400:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1788620334.657149:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa0d648583000:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788620334.657292:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620334.657527:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa0d666e8ec00:5825] 1 exiting: rc = 0 00000100:00100000:3.0:1788620334.658338:0:11663:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa0d67a578400:11663] 3 exiting: rc = 0 00000100:00100000:0.0:1788620334.659388:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa0d666e8e400:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1788620334.660331:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa0d666e8e600:5826] 2 exiting: rc = 0 00000100:00100000:0.0:1788620334.660475:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660483:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660494:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660500:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660506:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660512:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660518:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660524:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660529:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660536:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660542:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660562:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660568:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660575:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660582:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660587:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660593:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660600:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660617:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660623:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660629:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660634:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660640:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660645:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660651:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660655:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660660:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660666:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660671:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660676:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660680:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660685:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660690:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660695:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660700:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660704:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660710:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660715:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660720:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660725:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660730:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660735:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660910:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660918:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660923:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660928:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660940:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660944:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660949:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660965:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660971:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660976:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660981:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660986:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660991:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.660995:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661001:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661006:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661011:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661016:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661021:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661026:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661032:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.661037:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788620334.662005:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620334.662015:0:13217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788620334.662020:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d67a541800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788620334.662025:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d67a541800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788620334.662030:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788620334.662082:0:13217:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d675d13000 1 00000020:00000080:0.0:1788620334.662088:0:13217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24857de440bd036a 00000020:00000080:0.0:1788620334.662094:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d675d12800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788620334.662113:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788620334.662118:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620334.662122:0:13217:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788620334.662126:0:13217:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa0d664e10000) has no exports 00000020:00000080:3.0:1788620334.662238:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d675d12800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788620334.676913:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620334.676928:0:13217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788620334.676935:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d675d11800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788620334.676950:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d675d11800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788620334.676966:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788620334.677179:0:13217:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0d675d16800 00000020:01000000:0.0:1788620334.677202:0:13217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788620334.677206:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620334.677210:0:13217:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788620334.677214:0:13217:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffffa0d664e13370) has no exports 00000020:00000080:0.0:1788620334.677239:0:13217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620334.677245:0:13217:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788620334.677277:0:13217:0:(genops.c:885:class_export_put()) final put ffffa0d664dc7800/OSS_uuid 00000020:00000080:0.0:1788620334.677280:0:13217:0:(genops.c:844:class_export_destroy()) destroying export ffffa0d664dc7800/OSS_uuid for OSS 00000020:01000000:0.0:1788620334.677284:0:13217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788620334.677317:0:5835:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788620334.677489:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa0d6818d3000:6689] 2 exiting: rc = 0 00000100:00100000:0.0:1788620334.677540:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa0d6818d3400:6687] 1 exiting: rc = 0 00000100:00100000:0.0:1788620334.677599:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa0d675d5fe00:6686] 0 exiting: rc = 1 00000100:00100000:2.0:1788620334.680077:0:7779:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa0d6437e2600:7779] 3 exiting: rc = 0 00000100:00100000:3.0:1788620334.681100:0:12010:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffffa0d675ca6400:12010] 4 exiting: rc = 0 00000100:00100000:0.0:1788620334.681798:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681809:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681818:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681828:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681833:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681838:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681844:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681848:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681853:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681859:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681864:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681869:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681875:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681880:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681885:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681890:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681895:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681910:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681929:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681934:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681938:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681943:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681947:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681952:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681966:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681971:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681977:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681982:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681987:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681992:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.681998:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682002:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682007:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682012:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682017:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682022:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682027:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682032:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682037:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682042:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682299:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682306:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682311:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682316:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682322:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682329:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682335:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682342:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682347:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682352:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682358:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682362:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682367:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682380:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682387:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682391:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682396:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682401:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682406:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682411:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682416:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682421:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682427:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.682432:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620334.683684:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa0d650856800:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1788620334.684199:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa0d679b39c00:6691] 1 exiting: rc = 0 00000100:00100000:0.0:1788620334.684411:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684418:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684424:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684430:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684436:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684442:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684447:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684453:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684459:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684464:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684470:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684475:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684480:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684485:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684490:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684496:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684502:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684507:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684511:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684516:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684522:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684527:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684532:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684537:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684553:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684558:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684563:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684568:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684573:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684578:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684583:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684587:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684592:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684597:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684615:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684620:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684625:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684630:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684636:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684641:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684647:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684652:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684657:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684662:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684667:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684672:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684677:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684682:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684687:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684692:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684697:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684703:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684711:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684717:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684722:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684727:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684732:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684747:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684754:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684767:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684772:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684778:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684793:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.684798:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.687203:0:12407:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffffa0d650807c00:12407] 3 exiting: rc = 0 00000100:00100000:0.0:1788620334.687508:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa0d650800a00:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1788620334.688687:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa0d647d97a00:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1788620334.689237:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa0d66a3c5e00:6694] 2 exiting: rc = 0 00000100:00100000:0.0:1788620334.689595:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689613:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689619:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689624:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689632:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689647:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689654:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689661:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689667:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689679:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689684:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689690:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689696:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689703:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689732:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689751:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689757:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689765:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689771:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689777:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689791:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689800:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689806:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689813:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689818:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689824:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689829:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689834:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689852:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689858:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689864:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689870:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689875:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689881:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689887:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689892:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689898:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689914:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689936:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689943:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689948:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689963:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689969:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689976:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689982:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689987:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689993:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.689999:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690004:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690009:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690015:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690021:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690026:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690032:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690038:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690044:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690197:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690204:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690210:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690215:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690221:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690226:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690232:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.690245:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620334.696967:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0d67030b400:6695] 0 exiting: rc = 1 00000100:00100000:2.0:1788620334.697234:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa0d64357b400:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1788620334.697493:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697502:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697507:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697513:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697518:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697524:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697529:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697535:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697543:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697548:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697555:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697560:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697565:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697569:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697573:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697579:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697584:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697589:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697594:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697600:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697614:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697620:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697625:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697632:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697658:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697665:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697670:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697676:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697681:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697686:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697692:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697698:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697704:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697708:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697725:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697731:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697736:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697750:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697755:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697761:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697767:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697772:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697777:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697790:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697796:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697802:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697807:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697813:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697818:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697823:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697828:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697833:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697837:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697842:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697846:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697852:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697857:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697862:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697866:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697871:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697876:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697881:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697887:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.697892:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620334.698915:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa0d6464db600:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1788620334.704442:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0d679afae00:6698] 1 exiting: rc = 0 00000100:00100000:0.0:1788620334.704612:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704622:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704642:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704650:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704656:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704675:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704681:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704688:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704695:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704701:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704706:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704722:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704729:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704734:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704753:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704759:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704765:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704770:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704778:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704785:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704793:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704800:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704813:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704840:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704847:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704855:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704867:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704874:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704879:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704887:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704894:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704911:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704918:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704925:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704932:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704965:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704974:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704981:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704988:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.704994:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705007:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705013:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705019:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705026:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705033:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705040:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705332:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705357:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705365:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705371:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705378:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705386:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705393:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705401:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705408:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705416:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705422:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705427:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705433:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705454:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705462:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705467:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705473:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620334.705479:0:13217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788620334.717237:0:13217:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788620351.310388:0:13829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788620358.945885:0:14290:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788620358.945891:0:14290:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788620358.946004:0:14290:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0d679ecc000 00000020:01000004:2.0:1788620358.946019:0:14290:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788620358.946027:0:14290:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788620358.946040:0:14290:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa0d650640000) 00000020:00000080:2.0:1788620358.946054:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788620358.967882:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788620358.971633:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788620358.972553:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 417: rc = 0 00100000:10000000:3.0:1788620358.973006:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 417: rc = 0 00100000:10000000:3.0:1788620358.973101:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 417: rc = 0 00100000:10000000:3.0:1788620358.973568:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788620358.973765:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 417: rc = 0 00100000:10000000:3.0:1788620358.973944:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 417: rc = 0 00100000:10000000:3.0:1788620358.974043:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 417: rc = 0 00100000:10000000:3.0:1788620358.974352:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 419: rc = 0 00100000:10000000:3.0:1788620358.976185:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 452: rc = 0 00100000:10000000:3.0:1788620358.976319:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 452: rc = 0 00100000:10000000:3.0:1788620358.977134:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788620358.977964:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:3.0:1788620358.978203:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788620358.978808:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:3.0:1788620358.979121:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788620358.979601:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:3.0:1788620358.980042:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:3.0:1788620358.980278:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:3.0:1788620358.980964:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788620358.981200:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788620358.982043:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1788620358.982552:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788620358.983401:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 553: rc = 0 00100000:10000000:3.0:1788620358.984042:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 553: rc = 0 00100000:10000000:3.0:1788620358.984579:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 553: rc = 0 00100000:10000000:3.0:1788620358.984964:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 553: rc = 0 00100000:10000000:3.0:1788620358.985557:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 553: rc = 0 00100000:10000000:3.0:1788620358.986068:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 553: rc = 0 00100000:10000000:3.0:1788620358.990273:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 553: rc = 0 00100000:10000000:3.0:1788620358.991418:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 553: rc = 0 00100000:10000000:3.0:1788620358.991936:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 553: rc = 0 00100000:10000000:3.0:1788620358.992186:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 553: rc = 0 00100000:10000000:3.0:1788620358.993034:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 553: rc = 0 00100000:10000000:3.0:1788620358.993320:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 553: rc = 0 00100000:10000000:3.0:1788620358.994142:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 553: rc = 0 00100000:10000000:3.0:1788620358.995145:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 553: rc = 0 00100000:10000000:3.0:1788620358.995986:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 553: rc = 0 00100000:10000000:3.0:1788620358.996234:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 553: rc = 0 00100000:10000000:3.0:1788620358.997156:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 553: rc = 0 00100000:10000000:3.0:1788620358.997492:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 553: rc = 0 00100000:10000000:3.0:1788620358.997770:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 553: rc = 0 00100000:10000000:3.0:1788620358.998030:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 553: rc = 0 00100000:10000000:3.0:1788620358.998360:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 553: rc = 0 00100000:10000000:3.0:1788620358.998609:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 553: rc = 0 00100000:10000000:3.0:1788620358.998824:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 553: rc = 0 00100000:10000000:3.0:1788620358.999036:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 553: rc = 0 00100000:10000000:3.0:1788620358.999279:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 553: rc = 0 00100000:10000000:3.0:1788620358.999491:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 553: rc = 0 00100000:10000000:3.0:1788620358.999715:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 553: rc = 0 00100000:10000000:3.0:1788620358.999931:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 553: rc = 0 00100000:10000000:3.0:1788620359.000151:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 553: rc = 0 00100000:10000000:3.0:1788620359.000384:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 553: rc = 0 00100000:10000000:2.0:1788620359.003246:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 553: rc = 0 00100000:10000000:2.0:1788620359.003746:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 553: rc = 0 00100000:10000000:2.0:1788620359.004080:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 772: rc = 0 00100000:10000000:2.0:1788620359.005052:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788620359.005224:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 455: rc = 0 00100000:10000000:2.0:1788620359.006046:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788620359.006129:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 455: rc = 0 00100000:10000000:2.0:1788620359.006814:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788620359.008793:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 455: rc = 0 00100000:10000000:2.0:1788620359.013910:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788620359.014014:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 453: rc = 0 00100000:10000000:2.0:1788620359.014665:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788620359.014933:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 453: rc = 0 00100000:10000000:2.0:1788620359.015235:0:14290:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788620359.015582:0:14290:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 453: rc = 0 00000020:00000080:2.0:1788620359.016035:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788620359.016043:0:14290:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788620359.016052:0:14290:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd148f 00000020:01000004:2.0:1788620359.016061:0:14290:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788620359.016065:0:14290:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788620359.016070:0:14290:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0d679ecc000 from MGS 00000020:01000004:2.0:1788620359.016073:0:14290:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788620359.016083:0:14290:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa0d6506419b8) 00000020:00000080:2.0:1788620359.016093:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788620359.016212:0:14290:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d679ecc000 from MGS, refs=2 00080000:01000000:2.0:1788620359.016217:0:14290:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788620359.016223:0:14290:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd149d 00000100:00100000:2.0:1788620359.016977:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788620359.017116:0:14290:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788620359.017122:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788620359.018122:0:14290:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788620359.018130:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788620359.018526:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620359.018904:0:14290:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788620359.018909:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788620359.020176:0:14290:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788620359.020186:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788620359.020562:0:14290:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788620359.020643:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788620359.022578:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620359.022641:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620359.022644:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620359.022682:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620359.022741:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620359.022744:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620359.023144:0:14290:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788620359.028946:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788620359.056224:0:14290:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788620359.056241:0:14290:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788620359.056243:0:14290:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788620359.072371:0:14299:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788620359.072647:0:14290:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788620359.072773:0:14290:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788620359.073311:0:14290:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788620359.073643:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620359.073843:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788620359.073849:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788620359.078623:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788620359.078640:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788620359.079123:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788620359.079130:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788620359.080181:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788620359.080203:0:14290:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.111@tcp' 00000020:01000004:1.0:1788620359.080205:0:14290:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788620359.080235:0:14290:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.111@tcp (typ=mgc) 00000020:00000080:1.0:1788620359.080285:0:14290:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.111@tcp (ffffa0d679b9b370) 00000020:00000080:1.0:1788620359.080302:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788620359.080383:0:14290:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d680c09000@MGC192.168.201.111@tcp: add connection 192.168.201.111@tcp at head 00010000:00010000:1.0:1788620359.080516:0:14290:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.111@tcp-0 is initialized 00000040:01000000:1.0:1788620359.080522:0:14290:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788620359.080665:0:14304:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788620359.081837:0:14305:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788620359.081917:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.111@tcp (uuid 6b86f1d4-eff3-445d-9e1f-653b1e2161fe) 00000020:00000080:2.0:1788620359.081938:0:14290:0:(genops.c:1385:class_connect()) connect: client 6b86f1d4-eff3-445d-9e1f-653b1e2161fe, cookie 0x24857de440bd14ab 00000100:00080000:2.0:1788620359.081951:0:14290:0:(import.c:510:import_select_connection()) MGC192.168.201.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788620359.081958:0:14290:0:(import.c:624:import_select_connection()) MGC192.168.201.111@tcp: import ffffa0d680c09000 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:2.0:1788620359.081992:0:14290:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6807ded80 x1875504061826176/t0(0) o250->MGC192.168.201.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788620359.082029:0:14290:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6b86f1d4-eff3-445d-9e1f-653b1e2161fe->MGS 00000020:01000004:2.0:1788620359.082055:0:14290:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788620359.082060:0:14290:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788620359.082074:0:14290:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa0d650644d28) 00000020:00000080:2.0:1788620359.082085:0:14290:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788620359.082222:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3307:1875504061826176:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788620359.082346:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.082471:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061826176 00000100:00100000:1.0:1788620359.082479:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061826176 00000100:00100000:1.0:1788620359.082517:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620359.082525:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875504061826176:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788620359.082564:0:14301:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6b86f1d4-eff3-445d-9e1f-653b1e2161fe@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1788620359.082585:0:14301:0:(genops.c:1385:class_connect()) connect: client 6b86f1d4-eff3-445d-9e1f-653b1e2161fe, cookie 0x24857de440bd14b9 00000100:00080000:1.0:1788620359.082709:0:14301:0:(import.c:65:import_set_state_nolock()) ffffa0d680c0d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620359.082773:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+5:3307:x1875504061826176:12345-0@lo:250:mount.lustre.0 Request processed in 247us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620359.082781:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620359.082863:0:3307:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788620359.082871:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1788620359.082878:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788620359.082882:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788620359.082893:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d680c09000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788620359.082895:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788620359.082908:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788620359.082913:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3307:1875504061826176:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788620359.109343:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620359.110027:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788620359.110035:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788620359.114879:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788620359.114890:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788620359.116007:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788620359.116019:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788620359.119041:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620359.119178:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788620359.119182:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788620359.119644:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788620359.119650:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788620359.184409:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620359.184645:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788620359.184654:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788620359.187610:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788620359.187630:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788620359.188625:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620359.188797:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788620359.188803:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788620359.190019:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788620359.190029:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788620359.190646:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620359.190924:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788620359.190929:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788620359.191750:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788620359.191772:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788620359.194946:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620359.195139:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788620359.195145:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788620359.201296:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788620359.201313:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788620359.226055:0:14290:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620359.227214:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788620359.227225:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788620359.228835:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788620359.228848:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788620359.229737:0:14290:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788620359.229747:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788620359.230796:0:14290:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788620359.230821:0:14290:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788620359.230828:0:14290:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788620359.230973:0:14290:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788620359.231009:0:14290:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.111@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788620359.231014:0:14290:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788620359.231016:0:14290:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620359.231017:0:14290:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620359.231019:0:14290:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620359.231020:0:14290:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620359.231021:0:14290:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620359.231023:0:14290:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620359.231025:0:14290:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620359.231031:0:14290:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620359.231032:0:14290:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788620359.231034:0:14290:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788620359.231037:0:14290:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788620359.231038:0:14290:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620359.231039:0:14290:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620359.231039:0:14290:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620359.231040:0:14290:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620359.231041:0:14290:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620359.231042:0:14290:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620359.231043:0:14290:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620359.231044:0:14290:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620359.231045:0:14290:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788620359.231087:0:14290:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788620359.231107:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826304:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788620359.231183:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.231301:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65922b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788620359.231450:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061826304 00000100:00100000:2.0:1788620359.231457:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061826304 00000100:00100000:2.0:1788620359.231502:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620359.231511:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+5:14290:x1875504061826304:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788620359.231567:0:14303:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788620359.231674:0:14303:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788620359.231678:0:14303:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788620359.232036:0:14324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788620359.233008:0:14303:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788620359.234510:0:14325:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788620359.234517:0:14325:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788620359.234520:0:14325:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788620359.234567:0:14325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788620359.234918:0:14303:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788620359.234928:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788620359.243925:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+5:14290:x1875504061826304:12345-0@lo:253:mount.lustre.0 Request processed in 12406us (12733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620359.243941:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620359.243955:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620359.243975:0:14290:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788620359.243979:0:14290:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620359.243981:0:14290:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788620359.243983:0:14290:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620359.243984:0:14290:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620359.243985:0:14290:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620359.243987:0:14290:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620359.243988:0:14290:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788620359.243990:0:14290:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788620359.243992:0:14290:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620359.243993:0:14290:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788620359.244013:0:14290:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0d679ecc000 from lustre-MDT0000 10000000:01000000:2.0:1788620359.244042:0:14290:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788620359.244128:0:14290:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788620359.244133:0:14290:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0d679b9b370 10000000:01000000:2.0:1788620359.244138:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788620359.244146:0:14290:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0d679b9b370 from 1 10000000:01000000:2.0:1788620359.244148:0:14290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788620359.244188:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.244199:0:14290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.244210:0:14290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620359.244231:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620359.244524:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620359.244600:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6464ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.244739:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061826432 00000100:00100000:3.0:1788620359.244746:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061826432 00000100:00100000:3.0:1788620359.244857:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620359.244866:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+5:14290:x1875504061826432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620359.244879:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620359.244894:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641642200/0x24857de440bd14c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd14c0 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.244918:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642200/0x24857de440bd14c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd14c0 expref: 6 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.244929:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641642200/0x24857de440bd14c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd14c0 expref: 6 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.244938:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642200, rc 0) 00000100:00100000:3.0:1788620359.245021:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+6:14290:x1875504061826432:12345-0@lo:101:mount.lustre.0 Request processed in 157us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.245034:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620359.245166:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620359.245180:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.245189:0:14290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620359.245243:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620359.245542:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620359.245571:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6464ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620359.245798:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061826560 00000100:00100000:1.0:1788620359.245805:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061826560 00000100:00100000:1.0:1788620359.245838:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620359.245846:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+6:14290:x1875504061826560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620359.246109:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+6:14290:x1875504061826560:12345-0@lo:501:mount.lustre.0 Request processed in 263us (567us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788620359.246118:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620359.246735:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826560:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788620359.246782:0:14290:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788620359.246813:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.246823:0:14290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620359.246832:0:14290:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0d679ecc000 10000000:01000000:2.0:1788620359.246836:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788620359.246840:0:14290:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0d679ecc000 10000000:01000000:2.0:1788620359.246843:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788620359.246846:0:14290:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0d679ecc000 from 1 10000000:01000000:2.0:1788620359.246848:0:14290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788620359.246876:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2e00/0x24857de440bd14ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.246883:0:14290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2e00/0x24857de440bd14ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.246892:0:14290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2e00/0x24857de440bd14ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620359.246910:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620359.246945:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620359.246979:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6464ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620359.246992:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061826688 00000100:00100000:1.0:1788620359.246999:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061826688 00000100:00100000:1.0:1788620359.247042:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620359.247051:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+6:14290:x1875504061826688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620359.247069:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620359.247085:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d666e2ea00/0x24857de440bd14d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd14ce expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.247107:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2ea00/0x24857de440bd14d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd14ce expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.247118:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d666e2ea00/0x24857de440bd14d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd14ce expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.247127:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2ea00, rc 0) 00000100:00100000:1.0:1788620359.247172:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+7:14290:x1875504061826688:12345-0@lo:101:mount.lustre.0 Request processed in 122us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620359.247179:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620359.247291:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620359.247303:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2e00/0x24857de440bd14ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14d5 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620359.247312:0:14290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2e00/0x24857de440bd14ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd14d5 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620359.247326:0:14290:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788620359.247332:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2e00/0x24857de440bd14ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14d5 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620359.247339:0:14290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2e00/0x24857de440bd14ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14d5 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620359.247346:0:14290:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788620359.247350:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620359.247355:0:14290:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0d679ecc000 10000000:01000000:0.0:1788620359.247358:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788620359.247361:0:14290:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788620359.247363:0:14290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788620359.247386:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519000/0x24857de440bd14dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620359.247394:0:14290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d67a519000/0x24857de440bd14dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620359.247402:0:14290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d67a519000/0x24857de440bd14dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620359.247416:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620359.247446:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620359.247464:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061826816 00000100:00100000:2.0:1788620359.247468:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061826816 00000100:00100000:0.0:1788620359.247469:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6508c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620359.247488:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620359.247492:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+7:14290:x1875504061826816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620359.247497:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620359.247505:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3400/0x24857de440bd14e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd14dc expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.247523:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3400/0x24857de440bd14e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd14dc expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.247542:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe3400/0x24857de440bd14e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd14dc expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.247549:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3400, rc 0) 00000100:00100000:2.0:1788620359.247631:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+8:14290:x1875504061826816:12345-0@lo:101:mount.lustre.0 Request processed in 138us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620359.247636:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620359.250221:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620359.250679:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d67a519000/0x24857de440bd14dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14e3 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620359.250692:0:14290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d67a519000/0x24857de440bd14dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd14e3 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620359.250812:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620359.250870:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620359.250903:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6508c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620359.250929:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061826944 00000100:00100000:1.0:1788620359.250938:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061826944 00000100:00100000:1.0:1788620359.250993:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620359.251003:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+8:14290:x1875504061826944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620359.251459:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14290:x1875504061826944:12345-0@lo:501:mount.lustre.0 Request processed in 456us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620359.251467:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620359.251563:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061826944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620359.251597:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620359.251850:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620359.251938:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6508c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.253151:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061827072 00000100:00100000:3.0:1788620359.253161:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061827072 00000100:00100000:3.0:1788620359.253269:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788620359.253280:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14290:x1875504061827072:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620359.253920:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14290:x1875504061827072:12345-0@lo:503:mount.lustre.0 Request processed in 641us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.253928:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620359.255876:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620359.256980:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14326:1875504061827200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620359.257384:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620359.259098:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6508c4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788620359.261169:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061827200 00000100:00100000:1.0:1788620359.261181:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061827200 00000100:00100000:1.0:1788620359.261332:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620359.261342:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14326:x1875504061827200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620359.263929:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14326:x1875504061827200:12345-0@lo:502:llog_process_th.0 Request processed in 2581us (6537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620359.263959:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788620359.264099:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14326:1875504061827200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620359.264135:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620359.264148:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.264150:0:14326:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788620359.264156:0:14326:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788620359.264159:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788620359.264184:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa0d64501cd28) 00000020:00000080:3.0:1788620359.264202:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788620359.264208:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788620359.264329:0:14326:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788620359.264336:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd14f1 00000020:00000080:3.0:1788620359.264580:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788620359.264585:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620359.264644:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620359.264648:0:14326:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788620359.264653:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620359.264658:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620359.264659:0:14326:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788620359.264662:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620359.264671:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa0d650643370) 00000020:00000080:2.0:1788620359.264681:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788620359.264686:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788620359.264688:0:14326:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788620359.264690:0:14326:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788620359.264697:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788620359.264744:0:14326:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d679ecc000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788620359.264768:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0d68087cd28) 00000020:00000080:2.0:1788620359.264779:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788620359.264828:0:14326:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788620359.264833:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd1506 00000020:00000080:2.0:1788620359.264934:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788620359.264941:0:14326:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788620359.264945:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x24857de440bd150d 00080000:01000000:2.0:1788620359.264955:0:14326:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788620359.264959:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd1514 00010000:00010000:2.0:1788620359.342888:0:14326:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788620359.343388:0:14326:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788620359.343557:0:14326:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788620359.344121:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0d68087b370) 00000020:00000080:2.0:1788620359.344141:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788620359.344208:0:14326:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788620359.344214:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd1522 00000020:00000080:2.0:1788620359.348559:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788620359.352176:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x24857de440bd1529 00000020:00000080:2.0:1788620359.352482:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788620359.352492:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620359.352498:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620359.352501:0:14326:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788620359.352505:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620359.352511:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620359.352512:0:14326:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788620359.352517:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788620359.352561:0:14326:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788620359.352574:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620359.352577:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620359.352579:0:14326:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788620359.352581:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788620359.352583:0:14326:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788620359.352585:0:14326:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788620359.352587:0:14326:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788620359.352588:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788620359.352591:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620359.352592:0:14326:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788620359.352594:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788620359.352597:0:14326:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788620359.352601:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620359.352609:0:14326:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788620359.352613:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788620359.352618:0:14326:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.111@tcp to nid 0x20000c0a8c96f (192.168.201.111@tcp) 00000020:01000000:2.0:1788620359.352642:0:14326:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788620359.352645:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620359.352660:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0d680878000) 00000020:00000080:2.0:1788620359.352675:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788620359.352680:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788620359.352728:0:14326:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788620359.352733:0:14326:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788620359.352738:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd1537 00010000:00080000:2.0:1788620359.352767:0:14326:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d65141a800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.111@tcp at head 00010000:00010000:2.0:1788620359.352983:0:14326:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788620359.353327:0:14326:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788620359.353373:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788620359.354320:0:14326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620359.354371:0:14326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788620359.354446:0:14326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788620359.355711:0:14330:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788620359.355718:0:14330:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788620359.356415:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788620359.356427:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788620359.356469:0:14326:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788620359.356487:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd153e 00000100:00080000:3.0:1788620359.356497:0:14326:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788620359.356502:0:14326:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0d65141a800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:3.0:1788620359.356552:0:14326:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6808e9f80 x1875504061827328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620359.356627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061827328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788620359.356685:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875504061827328 offset 0 length 520: 4 00000100:00080000:3.0:1788620359.356854:0:14326:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788620359.356949:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620359.356953:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.356955:0:14326:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788620359.356958:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788620359.356960:0:14326:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788620359.356962:0:14326:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620359.356963:0:14326:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620359.356965:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788620359.356967:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.356968:0:14326:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788620359.356971:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788620359.356975:0:14326:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788620359.356978:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.356979:0:14326:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788620359.356982:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788620359.356985:0:14326:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.111@tcp to nid 0x20000c0a8c96f (192.168.201.111@tcp) 00000020:01000000:3.0:1788620359.357008:0:14326:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788620359.357011:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788620359.357023:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0d64501b370) 00000020:00000080:3.0:1788620359.357034:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788620359.357038:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788620359.357100:0:14326:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788620359.357106:0:14326:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788620359.357112:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24857de440bd154c 00010000:00080000:3.0:1788620359.357138:0:14326:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d66a6c9800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.111@tcp at head 00010000:00010000:3.0:1788620359.357358:0:14326:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788620359.357557:0:14326:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788620359.357577:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788620359.358050:0:14326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620359.358114:0:14326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788620359.358208:0:14326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788620359.358742:0:14332:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788620359.358747:0:14332:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788620359.359438:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788620359.359451:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788620359.359481:0:14326:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788620359.359500:0:14326:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd1553 00000100:00080000:3.0:1788620359.359509:0:14326:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788620359.359514:0:14326:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0d66a6c9800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:3.0:1788620359.359558:0:14326:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6808eb800 x1875504061827456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620359.359612:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061827456:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788620359.359664:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875504061827456 offset 0 length 520: 4 00000100:00080000:3.0:1788620359.359717:0:14326:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788620359.359765:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620359.359769:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.359771:0:14326:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788620359.359774:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620359.359777:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.359778:0:14326:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788620359.359781:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788620359.359783:0:14326:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788620359.359785:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620359.359788:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.359789:0:14326:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788620359.359792:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620359.359794:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.359795:0:14326:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788620359.359798:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788620359.359828:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14326:1875504061827584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620359.359880:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620359.359909:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061827584 00000100:00100000:3.0:1788620359.359914:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061827584 00000100:00100000:3.0:1788620359.359957:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620359.359965:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14326:x1875504061827584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620359.360183:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14326:x1875504061827584:12345-0@lo:502:llog_process_th.0 Request processed in 218us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.360191:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620359.360226:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d679fe53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.360245:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14326:1875504061827584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620359.360290:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620359.360294:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620359.360296:0:14326:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620359.360299:0:14326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788620359.360504:0:14290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788620359.360521:0:14290:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788620359.360577:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a519000/0x24857de440bd14dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14e3 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.360588:0:14290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d67a519000/0x24857de440bd14dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14e3 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620359.360596:0:14290:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d679ecc000 from 1 10000000:01000000:1.0:1788620359.360599:0:14290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788620359.360625:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.360632:0:14290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.360642:0:14290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.360655:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620359.360689:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.360719:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.360768:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061827712 00000100:00100000:3.0:1788620359.360773:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061827712 00000100:00100000:3.0:1788620359.360796:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620359.360803:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+9:14290:x1875504061827712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620359.360812:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620359.360826:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd155a expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.360847:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd155a expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.360856:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd155a expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.360864:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643c00, rc 0) 00000100:00100000:3.0:1788620359.360902:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+10:14290:x1875504061827712:12345-0@lo:101:mount.lustre.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.360908:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788620359.360972:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620359.360984:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.360993:0:14290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.361596:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827840:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788620359.361638:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.361656:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.361722:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061827840 00000100:00100000:3.0:1788620359.361733:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061827840 00000100:00100000:3.0:1788620359.361758:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788620359.361764:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+10:14290:x1875504061827840:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788620359.361778:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788620359.361785:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788620359.361848:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+10:14290:x1875504061827840:12345-0@lo:256:mount.lustre.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.361854:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788620359.361917:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827840:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788620359.362503:0:14290:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788620359.362697:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.362708:0:14290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620359.362715:0:14290:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d679ecc000 from 1 10000000:01000000:1.0:1788620359.362718:0:14290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788620359.362742:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.362749:0:14290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.362806:0:14290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.362822:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620359.362858:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.362889:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.362935:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061827968 00000100:00100000:3.0:1788620359.362940:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061827968 00000100:00100000:3.0:1788620359.362979:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620359.362986:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+10:14290:x1875504061827968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620359.362994:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620359.363005:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd1568 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.363023:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd1568 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.363033:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1568 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.363041:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642a00, rc 0) 00000100:00100000:3.0:1788620359.363082:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14290:x1875504061827968:12345-0@lo:101:mount.lustre.0 Request processed in 95us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.363088:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788620359.363150:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061827968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620359.363160:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.363168:0:14290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.363215:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620359.363239:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.363441:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.363510:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828096 00000100:00100000:3.0:1788620359.363514:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828096 00000100:00100000:3.0:1788620359.363555:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620359.363570:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14290:x1875504061828096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620359.363927:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14290:x1875504061828096:12345-0@lo:501:mount.lustre.0 Request processed in 357us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.363935:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788620359.364019:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620359.364049:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620359.364087:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.364109:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.364159:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828224 00000100:00100000:3.0:1788620359.364163:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828224 00000100:00100000:3.0:1788620359.364226:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788620359.364233:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14290:x1875504061828224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620359.364395:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14290:x1875504061828224:12345-0@lo:503:mount.lustre.0 Request processed in 162us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.364401:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620359.364551:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620359.368662:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14334:1875504061828352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620359.368741:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620359.368780:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6508c4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620359.368791:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828352 00000100:00100000:1.0:1788620359.368801:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828352 00000100:00100000:1.0:1788620359.368849:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620359.368859:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14334:x1875504061828352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620359.369175:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14334:x1875504061828352:12345-0@lo:502:llog_process_th.0 Request processed in 317us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620359.369185:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788620359.369513:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14334:1875504061828352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788620359.369559:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620359.369975:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620359.369979:0:14334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788620359.369991:0:14334:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d679ecc000 00000020:00000080:0.0:1788620359.369994:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788620359.370003:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620359.370005:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620359.370007:0:14334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788620359.370009:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620359.370012:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620359.370013:0:14334:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788620359.370016:0:14334:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d679ecc000 00000020:00000080:0.0:1788620359.370018:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788620359.370125:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620359.370129:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620359.370130:0:14334:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788620359.370133:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620359.370136:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620359.370137:0:14334:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788620359.370141:0:14334:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0d679ecc000 00000020:00000080:0.0:1788620359.370143:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788620359.375994:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14334:1875504061828480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620359.376084:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620359.376130:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6508c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.379635:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828480 00000100:00100000:3.0:1788620359.379649:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828480 00000100:00100000:3.0:1788620359.383616:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788620359.383633:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14334:x1875504061828480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620359.383896:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14334:x1875504061828480:12345-0@lo:502:llog_process_th.0 Request processed in 267us (7811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.383905:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788620359.384189:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14334:1875504061828480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788620359.384225:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620359.384233:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620359.384235:0:14334:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788620359.384241:0:14334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788620359.387554:0:14290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788620359.387582:0:14290:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788620359.387631:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.387643:0:14290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620359.387690:0:14290:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788620359.387692:0:14290:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0d679ecc000 10000000:01000000:1.0:1788620359.387696:0:14290:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0d679ecc000 10000000:01000000:1.0:1788620359.387700:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788620359.387705:0:14290:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d679ecc000 from 1 10000000:01000000:1.0:1788620359.387707:0:14290:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788620359.387740:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fc00/0x24857de440bd1576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.387748:0:14290:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fc00/0x24857de440bd1576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.387759:0:14290:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fc00/0x24857de440bd1576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.387781:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620359.387848:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.387922:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6464ed840 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.390704:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828608 00000100:00100000:3.0:1788620359.390718:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828608 00000100:00100000:3.0:1788620359.390816:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788620359.390828:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14290:x1875504061828608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620359.390848:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620359.390864:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641642400/0x24857de440bd157d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd1576 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.390894:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642400/0x24857de440bd157d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd1576 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.390915:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641642400/0x24857de440bd157d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1576 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.390925:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642400, rc 0) 00000100:00100000:3.0:1788620359.391004:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14290:x1875504061828608:12345-0@lo:101:mount.lustre.0 Request processed in 179us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.391012:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788620359.391089:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620359.391107:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fc00/0x24857de440bd1576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd157d expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.391116:0:14290:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fc00/0x24857de440bd1576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd157d expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.391180:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620359.391210:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.391543:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6464ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620359.393180:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828736 00000100:00100000:0.0:1788620359.393192:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828736 00000100:00100000:0.0:1788620359.393235:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788620359.393244:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14290:x1875504061828736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620359.393601:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14290:x1875504061828736:12345-0@lo:501:mount.lustre.0 Request processed in 357us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620359.393610:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788620359.393719:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620359.393765:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620359.393810:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.393866:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6464ed840 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.396514:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828864 00000100:00100000:3.0:1788620359.396538:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828864 00000100:00100000:0.0:1788620359.397659:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788620359.397845:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14290:x1875504061828864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620359.398144:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14290:x1875504061828864:12345-0@lo:503:mount.lustre.0 Request processed in 474us (4334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620359.398153:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788620359.400739:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680391f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061828864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620359.401134:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14340:1875504061828992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620359.401215:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620359.401450:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d650257c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788620359.401515:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061828992 00000100:00100000:2.0:1788620359.401531:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061828992 00000100:00100000:2.0:1788620359.401618:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788620359.401629:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14340:x1875504061828992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620359.401891:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14340:x1875504061828992:12345-0@lo:502:llog_process_th.0 Request processed in 263us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620359.401906:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788620359.401981:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14340:1875504061828992:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788620359.402042:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788620359.402057:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0d664e13370) 00000020:00000080:0.0:1788620359.402076:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788620359.402153:0:14340:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d679ecc000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788620359.402157:0:14340:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d679ecc000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788620359.402159:0:14340:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d679ecc000 4 00010000:00080000:0.0:1788620359.402188:0:14340:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d680401000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.111@tcp at head 00010000:00010000:0.0:1788620359.403917:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788620359.404160:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788620359.404192:0:14340:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788620359.404204:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x24857de440bd158b 00000100:00080000:0.0:1788620359.404218:0:14340:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620359.404224:0:14340:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0d680401000 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:0.0:1788620359.404282:0:14340:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6804aad80 x1875504061829120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788620359.404302:0:14340:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788620359.404498:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14340:1875504061829248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620359.404586:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.404828:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061829120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788620359.404864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620359.410447:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6508c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.410634:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061829248 00000100:00100000:3.0:1788620359.410643:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061829248 00000100:00100000:3.0:1788620359.410677:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061829120 00000100:00100000:3.0:1788620359.410680:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061829120 00000100:00100000:3.0:1788620359.410724:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620359.410732:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061829120:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788620359.410809:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061829120:12345-0@lo:38:llog_process_th.0 Request processed in 76us (5943us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788620359.410817:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620359.410861:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620359.410867:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6465eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14340:x1875504061829248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620359.411100:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6465eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14340:x1875504061829248:12345-0@lo:502:llog_process_th.0 Request processed in 232us (6513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620359.411108:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620359.411211:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14340:1875504061829248:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788620359.411245:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788620359.411418:0:14290:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788620359.411443:0:14290:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788620359.411502:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fc00/0x24857de440bd1576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd157d expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620359.411515:0:14290:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fc00/0x24857de440bd1576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd157d expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788620359.411573:0:14290:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788620359.411575:0:14290:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788620359.411576:0:14290:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620359.411578:0:14290:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620359.411579:0:14290:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620359.411580:0:14290:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620359.411582:0:14290:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788620359.411584:0:14290:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788620359.411585:0:14290:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620359.411587:0:14290:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788620359.411590:0:14290:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788620359.411592:0:14290:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788620359.411593:0:14290:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788620359.411594:0:14290:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620359.411595:0:14290:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620359.411596:0:14290:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620359.411597:0:14290:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620359.411598:0:14290:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788620359.411599:0:14290:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788620359.411600:0:14290:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620359.411601:0:14290:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788620359.411621:0:14290:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788620359.411636:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061829376:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788620359.411686:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620359.411710:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6507a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620359.411728:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061829376 00000100:00100000:3.0:1788620359.411733:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061829376 00000100:00100000:3.0:1788620359.411753:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788620359.411768:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6465e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14290:x1875504061829376:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788620359.411786:0:14301:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788620359.411798:0:14301:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788620359.412555:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788620359.412565:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d680401000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620359.412570:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788620359.412573:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061829120:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788620359.461392:0:14301:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788620359.461428:0:14301:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788620359.461486:0:14324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788620359.461495:0:14324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788620359.461517:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.461577:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd155a expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.461593:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.461650:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd155a expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.461671:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd155a expref: 12 pid: 14303 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.461687:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14324:1875504061829504:0@lo:104: 00000100:00100000:1.0:1788620359.461756:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620359.461906:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d644d2b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788620359.461970:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061829504 00000100:00100000:2.0:1788620359.461978:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061829504 00000100:00100000:2.0:1788620359.462151:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620359.462163:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14324:x1875504061829504:12345-0@lo:104: 00010000:00010000:2.0:1788620359.462185:0:14291:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.462289:0:14291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620359.462309:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14324:x1875504061829504:12345-0@lo:104: Request processed in 136us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620359.462317:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620359.462410:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14324:1875504061829504:0@lo:104: 00010000:00010000:1.0:1788620359.462433:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.462676:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620359.462687:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.462695:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2ec00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620359.462699:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.462714:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620359.462721:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620359.462727:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620359.462821:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.462849:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620359.462896:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.462903:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd155a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1561 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.462930:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620359.462933:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620359.462935:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620359.462967:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620359.462987:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061829632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620359.463035:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620359.463106:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061829632 00000100:00100000:2.0:1788620359.463112:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061829632 00010000:00010000:2.0:1788620359.463137:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd155a expref: 13 pid: 14303 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620359.463179:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620359.463187:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+13:3308:x1875504061829632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620359.463207:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620359.463213:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd155a expref: 13 pid: 14303 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463230:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd155a expref: 13 pid: 14303 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463244:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641643c00/0x24857de440bd1561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd155a expref: 13 pid: 14303 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463510:0:14293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463518:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788620359.463544:0:14293:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002053846s 00010000:00010000:2.0:1788620359.463549:0:14293:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463556:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463563:0:14293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463570:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463575:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2ee00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620359.463586:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463593:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463621:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620359.463631:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620359.463689:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:3308:x1875504061829632:12345-0@lo:103:ldlm_bl.0 Request processed in 503us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620359.463705:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620359.463746:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061829632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620359.463809:0:14324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.463818:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620359.463824:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1592 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620359.486796:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6465e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14290:x1875504061829376:12345-0@lo:253:mount.lustre.0 Request processed in 75017us (75098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620359.486827:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788620359.487016:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14290:1875504061829376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788620359.487032:0:14290:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788620359.487036:0:14290:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788620359.487037:0:14290:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788620359.487038:0:14290:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620359.487040:0:14290:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620359.487041:0:14290:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620359.487042:0:14290:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620359.487044:0:14290:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788620359.487046:0:14290:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788620359.487047:0:14290:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620359.487049:0:14290:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788620359.487063:0:14290:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788620359.493293:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620359.493764:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620359.494045:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620359.494214:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620359.494611:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620359.494737:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620359.495425:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620359.495570:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620359.495792:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620359.496021:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788620359.497767:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788620359.497914:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788620359.529540:0:14290:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788620359.529978:0:14290:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788620359.530159:0:14346:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788620359.530163:0:14346:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788620359.530452:0:14347:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788620359.530537:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620359.534132:0:14347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788620359.534224:0:14347:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788620359.534228:0:14347:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788620359.536423:0:14290:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788620359.536582:0:14290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788620359.537985:0:14290:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788620359.537999:0:14290:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788620359.538427:0:14290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620359.544493:0:14290:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788620359.545601:0:14290:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788620359.545648:0:14290:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788620359.550505:0:14290:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788620359.562238:0:14290:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788620359.650604:0:14290:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788620359.650645:0:14290:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd530145b988 00100000:10000000:2.0:1788620359.650653:0:14290:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788620359.654578:0:14290:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788620359.654597:0:14290:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788620359.654612:0:14290:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788620359.654638:0:14290:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788620360.045069:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620360.428827:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788620360.617526:0:14305:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788620360.617532:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d679ecc000 from 6 10000000:01000000:3.0:1788620360.617536:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788620360.617583:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620360.617596:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620360.617608:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620360.617633:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061829760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620360.617702:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620360.617751:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d642e4a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620360.617762:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061829760 00000100:00100000:2.0:1788620360.617770:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061829760 00000100:00100000:2.0:1788620360.617832:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788620360.617842:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6465e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14305:x1875504061829760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620360.617854:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620360.617866:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd1599 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620360.617888:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd1599 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620360.617898:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1599 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620360.617912:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2800, rc 0) 00000100:00100000:2.0:1788620360.617953:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6465e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061829760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620360.617972:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788620360.626658:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061829760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620360.626690:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620360.626708:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620360.626786:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061829888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788620360.626852:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620360.626895:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d642e4a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620360.630971:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061829888 00000100:00100000:1.0:1788620360.630989:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061829888 00000100:00100000:1.0:1788620360.631142:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620360.631153:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061829888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788620360.631180:0:14301:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788620360.631198:0:14301:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788620360.631202:0:14301:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788620360.632497:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061829888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1339us (5638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620360.632521:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788620360.634454:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061829888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788620360.634526:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788620360.634536:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620360.634548:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620361.064509:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620361.449000:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788620362.089907:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620363.112367:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620363.827086:0:14589:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788620364.136797:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788620364.649634:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620364.649647:0:13334:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788620364.649651:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620364.649654:0:13334:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788620364.649657:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788620364.649661:0:13334:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788620364.649665:0:13334:0:(import.c:65:import_set_state_nolock()) ffffa0d680401000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620364.649678:0:13334:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0d680401000 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:0.0:1788620364.649705:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061830016:0@lo:400:kworker.0 00000100:00100000:3.0:1788620364.649711:0:13334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6808e8e00 x1875504061830144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620364.649777:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620364.650197:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061830144:0@lo:38:kworker.0 00000100:00100000:0.0:1788620364.650232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620364.650311:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830016 00000100:00100000:0.0:1788620364.650318:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830016 00000100:00100000:0.0:1788620364.650364:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620364.650373:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:3310:x1875504061830016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620364.650780:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:3310:x1875504061830016:12345-0@lo:400:kworker.0 Request processed in 407us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620364.650788:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620364.650836:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061830016:0@lo:400:kworker.0 00000100:00100000:2.0:1788620364.655082:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830144 00000100:00100000:2.0:1788620364.655094:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830144 00000100:00100000:2.0:1788620364.655141:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620364.655149:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875504061830144:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788620364.655180:0:14310:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:2.0:1788620364.655221:0:14310:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x24857de440bd15a7 00000004:00100000:2.0:1788620364.655280:0:14310:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788620364.656414:0:14310:0:(import.c:65:import_set_state_nolock()) ffffa0d681a12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620364.656522:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875504061830144:12345-0@lo:38:kworker.0 Request processed in 1371us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620364.656531:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788620364.656647:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0d6808e8e00 x1875504061830144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788620364.656680:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788620364.656689:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788620364.656694:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788620364.656697:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d680401000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788620364.656703:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875504061830144:0@lo:38:kworker.0 00010000:00010000:0.0:1788620365.160585:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620366.187863:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788620366.503101:0:14740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff10531390 20000000:00000080:3.0:1788620366.503118:0:14740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0d67b729800 uarg=0000000000000000 20000000:01000000:3.0:1788620366.503151:0:14740:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788620366.503159:0:14740:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788620366.503163:0:14740:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788620366.505053:0:14741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788620366.505217:0:14740:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788620366.515966:0:14740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788620366.515995:0:14740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620366.516013:0:14740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1568 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620366.516023:0:14740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620366.516060:0:14740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd1568 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620366.516070:0:14740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd1568 expref: 11 pid: 14303 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620366.516081:0:14740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14740:1875504061830272:0@lo:104: 00000100:00100000:2.0:1788620366.516134:0:14740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620366.516183:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830272 00000100:00100000:3.0:1788620366.516192:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830272 00000100:00100000:2.0:1788620366.516197:0:14740:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a27f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788620366.516418:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620366.516429:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14740:x1875504061830272:12345-0@lo:104: 00010000:00010000:3.0:1788620366.516444:0:14291:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620366.516506:0:14291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788620366.516512:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14740:x1875504061830272:12345-0@lo:104: Request processed in 86us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620366.516520:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620366.516600:0:14740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14740:1875504061830272:0@lo:104: 00010000:00010000:2.0:1788620366.516623:0:14740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.516858:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620366.516866:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.516885:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fe00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:1.0:1788620366.516889:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.516898:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620366.516904:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620366.516910:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788620366.516951:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.516959:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620366.516982:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.516989:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d666e2fe00/0x24857de440bd1568 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd156f expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517005:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620366.517007:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620366.517009:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620366.517021:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061830400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620366.517055:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620366.517111:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830400 00000100:00100000:1.0:1788620366.517116:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830400 00010000:00010000:1.0:1788620366.517135:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1568 expref: 12 pid: 14303 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620366.517170:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620366.517176:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:3311:x1875504061830400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620366.517187:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620366.517191:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1568 expref: 12 pid: 14303 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517200:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd1568 expref: 12 pid: 14303 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517212:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642a00/0x24857de440bd156f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd1568 expref: 12 pid: 14303 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517223:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517230:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517242:0:14294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517269:0:14294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517275:0:14294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517281:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517296:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2a00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620366.517300:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517307:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517318:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620366.517327:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620366.517360:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:3311:x1875504061830400:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (303us total) trans 0 rc 0/0 00010000:00010000:2.0:1788620366.517361:0:14740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620366.517372:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788620366.517378:0:14740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620366.517387:0:14740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd15ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620366.517554:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061830400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620367.208866:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620368.232990:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788620368.361536:0:14305:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788620368.361543:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d679ecc000 from 10 10000000:01000000:0.0:1788620368.361549:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620368.361592:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620368.361604:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620368.361616:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620368.361641:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061830528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788620368.361723:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620368.361777:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830528 00000100:00100000:0.0:1788620368.361785:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620368.361786:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830528 00000100:00100000:2.0:1788620368.361846:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788620368.361856:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+11:14305:x1875504061830528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620368.361871:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620368.361884:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd15b5 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620368.361906:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd15b5 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620368.361918:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd15b5 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620368.361929:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3000, rc 0) 00000100:00100000:2.0:1788620368.361973:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061830528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620368.361980:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788620368.362067:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061830528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620368.362080:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620368.362089:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620368.362171:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061830656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620368.362196:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620368.362219:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620368.362279:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830656 00000100:00100000:2.0:1788620368.362283:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830656 00000100:00100000:2.0:1788620368.362307:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788620368.362313:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061830656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620368.362565:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061830656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620368.362572:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788620368.362645:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061830656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620368.362673:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061830784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620368.362711:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620368.362741:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620368.362835:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830784 00000100:00100000:2.0:1788620368.362839:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830784 00000100:00100000:2.0:1788620368.362875:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788620368.362882:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061830784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620368.363010:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14305:x1875504061830784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620368.363016:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788620368.363084:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061830784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788620368.364042:0:14829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788620368.364376:0:14305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788620368.364397:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620368.364407:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620368.364418:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620369.260700:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620369.769788:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620359/real 1788620359] req@ffffa0d6808eb800 x1875504061827456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620369.769821:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0d6808eb800 x1875504061827456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620369.769869:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620359/real 1788620359] req@ffffa0d6808e9f80 x1875504061827328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620369.769882:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0d6808e9f80 x1875504061827328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788620369.769900:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788620369.769908:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788620369.769912:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061827456:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788620369.769918:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d65141a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788620369.769922:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788620369.769924:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061827328:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788620369.770056:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620369.770060:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788620369.770063:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0d65141a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788620369.770068:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:0.0:1788620369.770074:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788620369.770080:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0d65141a800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:0.0:1788620369.770101:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6804abb80 x1875504061831040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788620369.770115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620369.770118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788620369.770119:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788620369.770123:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:0.0:1788620369.770136:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788620369.770140:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0d66a6c9800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:0.0:1788620369.770170:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6804ab100 x1875504061831168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620369.770205:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061831296:0@lo:400:kworker.0 00000100:00100000:0.0:1788620369.770425:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620369.770493:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620369.770499:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3309:1875504061830912:0@lo:400:kworker.0 00000100:00100000:0.0:1788620369.770551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620369.770603:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061831296 00000100:00100000:0.0:1788620369.770611:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061831296 00000100:00100000:0.0:1788620369.770657:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620369.770666:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061831296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620369.770720:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061831296:12345-0@lo:400:kworker.0 Request processed in 54us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620369.770727:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620369.770753:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061830912 00000100:00100000:0.0:1788620369.770756:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061830912 00000100:00100000:0.0:1788620369.770788:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620369.770795:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:3309:x1875504061830912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620369.770826:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:3309:x1875504061830912:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620369.770833:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620369.770864:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061831040:0@lo:8:kworker.0 00000400:00000100:0.0:1788620369.770886:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875504061831040 offset 0 length 520: 4 00000100:00100000:0.0:1788620369.770900:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061831168:0@lo:8:kworker.0 00000400:00000100:0.0:1788620369.770917:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875504061831168 offset 0 length 520: 4 00000100:00100000:0.0:1788620369.770960:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3309:1875504061830912:0@lo:400:kworker.0 00010000:00080000:0.0:1788620369.770971:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0d6804a9f80 x1875504061831296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620369.770981:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061831296:0@lo:400:kworker.0 00010000:00010000:1.0:1788620370.280732:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788620371.214546:0:14988:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788620371.214550:0:14988:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788620371.214656:0:14988:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0d65899a000 00000020:01000004:2.0:1788620371.214675:0:14988:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788620371.214688:0:14988:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788620371.214702:0:14988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0d6808799b8) 00000020:00000080:2.0:1788620371.214717:0:14988:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788620371.233352:0:14988:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788620371.233634:0:14988:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788620371.235621:0:14988:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788620371.235878:0:14988:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788620371.236124:0:14988:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788620371.236772:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 337: rc = 0 00100000:10000000:3.0:1788620371.236914:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 337: rc = 0 00100000:10000000:3.0:1788620371.236999:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 337: rc = 0 00100000:10000000:3.0:1788620371.237999:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 521: rc = 0 00100000:10000000:3.0:1788620371.238246:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 521: rc = 0 00100000:10000000:3.0:1788620371.242506:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 521: rc = 0 00100000:10000000:3.0:1788620371.242809:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 521: rc = 0 00100000:10000000:3.0:1788620371.243067:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 521: rc = 0 00100000:10000000:3.0:1788620371.244495:0:14988:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 521: rc = 0 00000020:00000080:3.0:1788620371.245134:0:14988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788620371.245147:0:14988:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788620371.245158:0:14988:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24857de440bd15ca 00000020:01000004:3.0:1788620371.245166:0:14988:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788620371.245187:0:14988:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788620371.245191:0:14988:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788620371.245197:0:14988:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788620371.245201:0:14988:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788620371.245212:0:14988:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0d645018000) 00000020:00000080:3.0:1788620371.245221:0:14988:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788620371.246546:0:14988:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620371.246721:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788620371.246728:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788620371.250743:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788620371.250866:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788620371.251517:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788620371.251524:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788620371.255611:0:14988:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620371.255769:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788620371.255773:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788620371.256657:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788620371.256664:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788620371.278498:0:14988:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620371.278704:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788620371.278709:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788620371.286937:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788620371.286952:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788620371.290052:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788620371.290681:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788620371.293761:0:14988:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620371.293964:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788620371.293971:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788620371.296904:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788620371.296920:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1788620371.304470:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620371.336457:0:14988:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788620371.336725:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788620371.336732:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788620371.337767:0:14988:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788620371.337776:0:14988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788620371.338164:0:14988:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788620371.338189:0:14988:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788620371.338196:0:14988:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788620371.354681:0:14988:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788620371.354721:0:14988:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.111@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788620371.354725:0:14988:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788620371.354727:0:14988:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788620371.354728:0:14988:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620371.354729:0:14988:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620371.354735:0:14988:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620371.354736:0:14988:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620371.354737:0:14988:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620371.354739:0:14988:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620371.354740:0:14988:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788620371.354744:0:14988:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788620371.354746:0:14988:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788620371.354801:0:14988:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788620371.354803:0:14988:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620371.354804:0:14988:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620371.354804:0:14988:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620371.354806:0:14988:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620371.354807:0:14988:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620371.354808:0:14988:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620371.354809:0:14988:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788620371.354837:0:14988:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788620371.354856:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788620371.354928:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.355027:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620371.355075:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061831424 00000100:00100000:0.0:1788620371.355085:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061831424 00000100:00100000:0.0:1788620371.355639:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788620371.355652:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14988:x1875504061831424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620371.355708:0:14303:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788620371.355711:0:14303:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788620371.355715:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788620371.369024:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14988:x1875504061831424:12345-0@lo:253:mount.lustre.0 Request processed in 13365us (14086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.369040:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788620371.369186:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788620371.369202:0:14988:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788620371.369206:0:14988:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788620371.369207:0:14988:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788620371.369208:0:14988:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620371.369210:0:14988:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620371.369211:0:14988:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620371.369213:0:14988:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620371.369214:0:14988:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620371.369216:0:14988:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620371.369394:0:14988:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788620371.369415:0:14988:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0d65899a000 from lustre-OST0000 10000000:01000000:3.0:1788620371.369439:0:14988:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788620371.369442:0:14988:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788620371.369449:0:14988:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0d679b9b370 local copy 00010000:00010000:3.0:1788620371.369460:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620371.369778:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620371.369821:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.371397:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851840 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.371598:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061831552 00000100:00100000:2.0:1788620371.371607:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061831552 00000100:00100000:2.0:1788620371.371708:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788620371.371718:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14988:x1875504061831552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620371.372453:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14988:x1875504061831552:12345-0@lo:501:mount.lustre.0 Request processed in 734us (2629us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788620371.372464:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788620371.372624:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831552:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788620371.372648:0:14988:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788620371.372839:0:14988:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788620371.372848:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.372859:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620371.372881:0:14988:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0d65899a000 10000000:01000000:3.0:1788620371.372886:0:14988:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788620371.372890:0:14988:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0d679b9b370 10000000:01000000:3.0:1788620371.372893:0:14988:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788620371.372895:0:14988:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0d679b9b370 from 1 10000000:01000000:3.0:1788620371.372898:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788620371.372929:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642000/0x24857de440bd15d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.372936:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641642000/0x24857de440bd15d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.372946:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641642000/0x24857de440bd15d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620371.372977:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788620371.373015:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.373278:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620371.373424:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061831680 00000100:00100000:0.0:1788620371.373431:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061831680 00000100:00100000:0.0:1788620371.373466:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788620371.373474:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+12:14988:x1875504061831680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620371.373485:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620371.373514:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a519200/0x24857de440bd15df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd15d8 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.373539:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a519200/0x24857de440bd15df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd15d8 expref: 13 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.373550:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a519200/0x24857de440bd15df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd15d8 expref: 13 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.373559:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519200, rc 0) 00000100:00100000:0.0:1788620371.373601:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+13:14988:x1875504061831680:12345-0@lo:101:mount.lustre.0 Request processed in 129us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.373615:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788620371.373756:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620371.373769:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641642000/0x24857de440bd15d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15df expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.373779:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641642000/0x24857de440bd15d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd15df expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620371.373795:0:14988:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788620371.373813:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642000/0x24857de440bd15d8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15df expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.373820:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641642000/0x24857de440bd15d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15df expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620371.373827:0:14988:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788620371.373831:0:14988:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788620371.373836:0:14988:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788620371.373838:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788620371.373852:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643200/0x24857de440bd15e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.373858:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641643200/0x24857de440bd15e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.373865:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641643200/0x24857de440bd15e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620371.373886:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788620371.373915:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.373934:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851840 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.373990:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061831808 00000100:00100000:2.0:1788620371.373995:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061831808 00000100:00100000:2.0:1788620371.374017:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788620371.374024:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+13:14988:x1875504061831808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620371.374031:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620371.374040:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3200/0x24857de440bd15ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd15e6 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.374067:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3200/0x24857de440bd15ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd15e6 expref: 14 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.374075:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe3200/0x24857de440bd15ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd15e6 expref: 14 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.374082:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3200, rc 0) 00000100:00100000:2.0:1788620371.374203:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061831808:12345-0@lo:101:mount.lustre.0 Request processed in 179us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.374209:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788620371.374291:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620371.374301:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641643200/0x24857de440bd15e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15ed expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.374308:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641643200/0x24857de440bd15e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd15ed expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620371.375018:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788620371.376431:0:14988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620371.376698:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788620371.376741:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788620371.376774:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788620371.376820:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788620371.376854:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788620371.376886:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788620371.376948:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788620371.376956:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788620371.377038:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620371.377116:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.377157:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.377422:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061831936 00000100:00100000:2.0:1788620371.377430:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061831936 00000100:00100000:2.0:1788620371.377496:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788620371.377506:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061831936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620371.377842:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061831936:12345-0@lo:501:mount.lustre.0 Request processed in 337us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.377851:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788620371.378002:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061831936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620371.378039:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620371.378079:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.378127:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620371.378241:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832064 00000100:00100000:1.0:1788620371.378276:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832064 00000100:00100000:1.0:1788620371.378309:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788620371.378327:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061832064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620371.378677:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061832064:12345-0@lo:503:mount.lustre.0 Request processed in 360us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620371.378684:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788620371.378838:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832064:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788620371.379764:0:14988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620371.379843:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620371.379896:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.379974:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620371.380077:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832192 00000100:00100000:1.0:1788620371.380089:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832192 00000100:00100000:1.0:1788620371.380243:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788620371.380279:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061832192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620371.380481:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061832192:12345-0@lo:502:mount.lustre.0 Request processed in 204us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620371.380603:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620371.380825:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788620371.380872:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788620371.380906:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788620371.380953:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788620371.380989:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788620371.381021:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788620371.381069:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788620371.381186:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788620371.381230:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000100:00100000:1.0:1788620371.381346:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000040:00080000:3.0:1788620371.381471:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788620371.381583:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788620371.381629:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788620371.381663:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620371.381715:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.381758:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.381825:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832320 00000100:00100000:2.0:1788620371.381831:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832320 00000100:00100000:2.0:1788620371.381914:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788620371.381923:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061832320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620371.382090:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061832320:12345-0@lo:502:mount.lustre.0 Request processed in 168us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.382107:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788620371.382176:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620371.382239:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788620371.382270:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788620371.384574:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788620371.384590:0:15002:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788620371.384600:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620371.384616:0:15002:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788620371.384627:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788620371.384645:0:15002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0d6450199b8) 00000020:00000080:3.0:1788620371.384671:0:15002:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788620371.384677:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788620371.384763:0:15002:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d65899a000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788620371.384771:0:15002:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788620371.384778:0:15002:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24857de440bd15fb 00010000:00010000:3.0:1788620371.389026:0:15002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788620371.390482:0:15002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788620371.392408:0:15002:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788620371.393828:0:15002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788620371.393841:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620371.393848:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620371.393850:0:15002:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788620371.393855:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788620371.393858:0:15002:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788620371.393859:0:15002:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788620371.393861:0:15002:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788620371.393862:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788620371.393867:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620371.393868:0:15002:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788620371.393870:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620371.393874:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620371.393875:0:15002:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788620371.393877:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788620371.393879:0:15002:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788620371.393881:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620371.393883:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620371.393885:0:15002:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788620371.393887:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620371.393889:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620371.393890:0:15002:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788620371.393893:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788620371.393946:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620371.393949:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620371.393951:0:15002:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788620371.393954:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788620371.394195:0:14988:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788620371.394219:0:14988:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788620371.394245:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643200/0x24857de440bd15e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15ed expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.394285:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641643200/0x24857de440bd15e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd15ed expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620371.394293:0:14988:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d65899a000 from 1 10000000:01000000:2.0:1788620371.394297:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788620371.394339:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.394348:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.394360:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620371.394383:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620371.394458:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620371.394696:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d541f73180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620371.395373:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832448 00000100:00100000:0.0:1788620371.395383:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832448 00000100:00100000:0.0:1788620371.395438:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788620371.395448:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+14:14988:x1875504061832448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620371.395476:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620371.395500:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd1602 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.395527:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd1602 expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.395538:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1602 expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.395546:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519400, rc 0) 00000100:00100000:0.0:1788620371.397626:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832448:12345-0@lo:101:mount.lustre.0 Request processed in 2171us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.397637:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788620371.398386:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620371.398411:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.398424:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620371.398999:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788620371.401899:0:14988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620371.402337:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788620371.402385:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788620371.402448:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788620371.402457:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788620371.402629:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620371.402722:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.402774:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.402933:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832576 00000100:00100000:2.0:1788620371.402941:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832576 00000100:00100000:2.0:1788620371.402998:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788620371.403009:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620371.403273:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832576:12345-0@lo:501:mount.lustre.0 Request processed in 266us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.403282:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788620371.403469:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620371.403584:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620371.403626:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.403656:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.403702:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832704 00000100:00100000:2.0:1788620371.403706:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832704 00000100:00100000:2.0:1788620371.403774:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788620371.403782:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620371.403918:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832704:12345-0@lo:503:mount.lustre.0 Request processed in 137us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.403925:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788620371.407380:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788620371.408892:0:14988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788620371.408989:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620371.409073:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.409607:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620371.410667:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832832 00000100:00100000:1.0:1788620371.410678:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832832 00000100:00100000:1.0:1788620371.410757:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788620371.410769:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620371.411028:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832832:12345-0@lo:502:mount.lustre.0 Request processed in 262us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620371.411037:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788620371.411143:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620371.411739:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788620371.411796:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788620371.411861:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788620371.411900:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788620371.411932:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788620371.411981:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788620371.412029:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788620371.412062:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788620371.412161:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620371.412217:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620371.412394:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ce9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788620371.412483:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061832960 00000100:00100000:0.0:1788620371.412499:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061832960 00000100:00100000:0.0:1788620371.412536:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788620371.412545:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620371.412728:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061832960:12345-0@lo:502:mount.lustre.0 Request processed in 184us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.412736:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788620371.412876:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061832960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620371.412965:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788620371.412976:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788620371.413939:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620371.413949:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620371.413951:0:15006:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788620371.413958:0:15006:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d65899a000 00000020:00000080:1.0:1788620371.413961:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788620371.413968:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620371.413970:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620371.413971:0:15006:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788620371.413974:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620371.413976:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620371.413978:0:15006:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788620371.413981:0:15006:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d65899a000 00000020:00000080:1.0:1788620371.413982:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788620371.414047:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620371.414052:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620371.414053:0:15006:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788620371.414056:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788620371.414068:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620371.414069:0:15006:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788620371.414074:0:15006:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0d65899a000 00000020:00000080:1.0:1788620371.414076:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788620371.414188:0:15006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620371.414192:0:15006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620371.414193:0:15006:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788620371.414197:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788620371.415217:0:14988:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788620371.415272:0:14988:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620371.415292:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.415304:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620371.415368:0:14988:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788620371.415371:0:14988:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0d65899a000 10000000:01000000:0.0:1788620371.415374:0:14988:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0d65899a000 10000000:01000000:0.0:1788620371.415379:0:14988:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620371.415384:0:14988:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d65899a000 from 1 10000000:01000000:0.0:1788620371.415387:0:14988:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788620371.415421:0:14988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a518600/0x24857de440bd1610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.415429:0:14988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d67a518600/0x24857de440bd1610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.415439:0:14988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d67a518600/0x24857de440bd1610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620371.415460:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620371.415606:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.415649:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833088 00000100:00100000:0.0:1788620371.415657:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833088 00000100:00100000:0.0:1788620371.415700:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788620371.415710:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061833088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620371.415724:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620371.415737:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a518a00/0x24857de440bd1617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd1610 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.415760:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a518a00/0x24857de440bd1617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd1610 expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.415783:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a518a00/0x24857de440bd1617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1610 expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.415791:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518a00, rc 0) 00000100:00100000:0.0:1788620371.415827:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833088:12345-0@lo:101:mount.lustre.0 Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.415833:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788620371.415880:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620371.415899:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620371.415914:0:14988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d67a518600/0x24857de440bd1610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1617 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.415923:0:14988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d67a518600/0x24857de440bd1610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd1617 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620371.418781:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788620371.419269:0:14988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620371.420436:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788620371.420831:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788620371.420873:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788620371.420922:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788620371.420960:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788620371.421011:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788620371.421047:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788620371.421081:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788620371.421211:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788620371.422367:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788620371.422438:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788620371.422560:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788620371.422594:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788620371.422620:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788620371.422656:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788620371.422683:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788620371.422708:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788620371.422743:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788620371.422774:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788620371.422808:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788620371.422854:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788620371.422889:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788620371.422945:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788620371.422999:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788620371.423030:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788620371.423058:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788620371.423095:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788620371.423205:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788620371.423354:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788620371.423363:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788620371.423573:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620371.423656:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.423710:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.425292:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833216 00000100:00100000:2.0:1788620371.425311:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833216 00000100:00100000:2.0:1788620371.425402:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788620371.425414:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620371.426680:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833216:12345-0@lo:501:mount.lustre.0 Request processed in 1257us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.426697:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788620371.426918:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620371.426999:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620371.427068:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620371.427197:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833344 00000100:00100000:2.0:1788620371.427205:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833344 00000100:00100000:2.0:1788620371.427246:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788620371.427285:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620371.427602:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.428668:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833344:12345-0@lo:503:mount.lustre.0 Request processed in 1376us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.428683:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788620371.428904:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788620371.433368:0:14988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788620371.433647:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620371.433769:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.433834:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833472 00000100:00100000:0.0:1788620371.433845:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833472 00000100:00100000:0.0:1788620371.434615:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788620371.434632:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620371.434941:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833472:12345-0@lo:502:mount.lustre.0 Request processed in 313us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.434950:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788620371.436656:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d681a1bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620371.436721:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788620371.437096:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788620371.437163:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788620371.437191:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788620371.437233:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788620371.437302:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788620371.437362:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788620371.437393:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788620371.437422:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788620371.437466:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788620371.437499:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788620371.437526:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788620371.437584:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788620371.437619:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788620371.437650:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788620371.437761:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788620371.437798:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788620371.437850:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788620371.437902:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788620371.437937:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788620371.437970:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788620371.438017:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788620371.438057:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788620371.438105:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788620371.438154:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788620371.438187:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788620371.438216:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788620371.438297:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788620371.438350:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788620371.438383:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788620371.438448:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788620371.438489:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788620371.438524:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788620371.438577:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788620371.438625:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788620371.438662:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788620371.438708:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788620371.438742:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788620371.438777:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788620371.438823:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788620371.438857:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788620371.438934:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620371.439070:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620371.441091:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad240 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.444345:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833600 00000100:00100000:2.0:1788620371.444366:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833600 00000100:00100000:2.0:1788620371.444442:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788620371.444454:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620371.445716:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833600:12345-0@lo:502:mount.lustre.0 Request processed in 1254us (6635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.445733:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620371.446329:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788620371.446519:0:14988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788620371.446543:0:14988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788620371.452736:0:15011:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788620371.452754:0:15011:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0d664e10000) 00000020:00000080:0.0:1788620371.452777:0:15011:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788620371.452863:0:15011:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d65899a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788620371.452867:0:15011:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d65899a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788620371.452869:0:15011:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d65899a000 3 00010000:00080000:0.0:1788620371.452901:0:15011:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d65924a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.111@tcp at head 00010000:00010000:0.0:1788620371.459765:0:15011:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788620371.459953:0:15011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788620371.459989:0:15011:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788620371.460000:0:15011:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x24857de440bd1625 00000100:00080000:0.0:1788620371.460010:0:15011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620371.460015:0:15011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0d65924a000 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:0.0:1788620371.460047:0:15011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6804a8a80 x1875504061833728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620371.460086:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875504061833728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788620371.460147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788620371.460192:0:15011:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788620371.460215:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620371.460225:0:13334:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788620371.460228:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620371.460230:0:13334:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788620371.460294:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061833856:0@lo:400:kworker.0 00000100:00100000:2.0:1788620371.462050:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833728 00000100:00100000:2.0:1788620371.462065:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833728 00000100:00100000:0.0:1788620371.462215:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.462303:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833856 00000100:00100000:0.0:1788620371.462307:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833856 00000100:00100000:0.0:1788620371.462349:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620371.462359:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061833856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620371.462423:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061833856:12345-0@lo:400:kworker.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.462430:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620371.462447:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788620371.462451:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875504061833728:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788620371.462472:0:14308:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:0.0:1788620371.462516:0:14308:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x24857de440bd162c 00000004:00100000:0.0:1788620371.462532:0:14308:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788620371.462564:0:14308:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620371.462605:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875504061833728:12345-0@lo:38:llog_process_th.0 Request processed in 152us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.462611:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788620371.462651:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0d6804a9880 x1875504061833856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620371.462665:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061833856:0@lo:400:kworker.0 00010000:00080000:0.0:1788620371.462706:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0d6804a8a80 x1875504061833728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620371.462714:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788620371.462721:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788620371.462729:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788620371.462733:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788620371.462735:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d65924a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788620371.462740:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875504061833728:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788620371.465467:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788620371.465537:0:14988:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788620371.465567:0:14988:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788620371.465592:0:14988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d67a518600/0x24857de440bd1610 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1617 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620371.465604:0:14988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d67a518600/0x24857de440bd1610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1617 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788620371.465653:0:14988:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788620371.465655:0:14988:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788620371.465656:0:14988:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620371.465657:0:14988:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620371.465658:0:14988:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620371.465659:0:14988:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620371.465660:0:14988:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620371.465662:0:14988:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620371.465663:0:14988:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788620371.465667:0:14988:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788620371.465669:0:14988:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788620371.465671:0:14988:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788620371.465672:0:14988:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620371.465677:0:14988:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620371.465678:0:14988:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620371.465679:0:14988:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620371.465680:0:14988:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620371.465681:0:14988:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620371.465681:0:14988:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788620371.465710:0:14988:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788620371.465731:0:14988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788620371.465819:0:14988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620371.465862:0:14988:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64243d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.467234:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061833984 00000100:00100000:2.0:1788620371.467262:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061833984 00000100:00100000:2.0:1788620371.467353:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788620371.467365:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14988:x1875504061833984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788620371.467398:0:14301:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788620371.467413:0:14301:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788620371.512477:0:14301:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788620371.512509:0:14301:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788620371.512906:0:14324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788620371.512912:0:14324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788620371.512935:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.512957:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1599 expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.512966:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.513015:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd1599 expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.513029:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd1599 expref: 16 pid: 14302 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620371.513042:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14324:1875504061834112:0@lo:104: 00000100:00100000:3.0:1788620371.513150:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620371.513192:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d680851240 going to sleep for 11 seconds 00000100:00100000:2.0:1788620371.513392:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061834112 00000100:00100000:2.0:1788620371.513402:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061834112 00000100:00100000:2.0:1788620371.513448:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620371.513458:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14324:x1875504061834112:12345-0@lo:104: 00010000:00010000:2.0:1788620371.513604:0:14292:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.513678:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620371.513685:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14324:x1875504061834112:12345-0@lo:104: Request processed in 228us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.513692:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788620371.513722:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620371.513729:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.513736:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643600 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620371.513740:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.513749:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620371.513757:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620371.513763:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620371.513794:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.513801:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620371.513823:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.513829:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd1599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd15a0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.513853:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620371.513854:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620371.513856:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620371.513876:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061834240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620371.513907:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620371.513945:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061834240 00000100:00100000:2.0:1788620371.513949:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061834240 00010000:00010000:2.0:1788620371.513967:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1599 expref: 17 pid: 14302 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620371.513990:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620371.513997:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:3311:x1875504061834240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620371.514008:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620371.514014:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1599 expref: 17 pid: 14302 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514024:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd1599 expref: 17 pid: 14302 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514043:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514051:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788620371.514064:0:14295:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002053846s 00010000:00010000:2.0:1788620371.514069:0:14295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514086:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514094:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.514207:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2800/0x24857de440bd15a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd1599 expref: 17 pid: 14302 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620371.514224:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14324:1875504061834112:0@lo:104: 00010000:00010000:2.0:1788620371.514528:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.514723:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.514734:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620371.514740:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514768:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620371.514773:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514781:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514789:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514796:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642600/0x24857de440bd1633 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620371.514809:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620371.514899:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3311:x1875504061834240:12345-0@lo:103:ldlm_bl.0 Request processed in 902us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620371.514907:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788620371.518859:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061834240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620371.520615:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14988:x1875504061833984:12345-0@lo:253:mount.lustre.0 Request processed in 53245us (54789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620371.520630:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788620371.520776:0:14988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14988:1875504061833984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620371.520791:0:14988:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788620371.520794:0:14988:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620371.520810:0:14988:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620371.520811:0:14988:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620371.520813:0:14988:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620371.520814:0:14988:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620371.520815:0:14988:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620371.520817:0:14988:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620371.520818:0:14988:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620371.520820:0:14988:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788620371.520833:0:14988:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788620371.530630:0:14988:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620371.530807:0:14988:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620371.530984:0:14988:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620371.531213:0:14988:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620371.531482:0:14988:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620371.531807:0:14988:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788620371.532971:0:14988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788620371.585003:0:14988:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788620371.585014:0:14988:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788620371.585059:0:14988:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788620371.585130:0:14988:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788620371.585146:0:14988:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788620371.585174:0:14988:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:3.0:1788620371.690021:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788620372.334276:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620373.352562:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788620373.480440:0:14305:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788620373.480450:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d679ecc000 from 7 10000000:01000000:2.0:1788620373.480457:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788620373.480519:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620373.480533:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620373.480547:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620373.480575:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061834368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620373.480646:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620373.480741:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6500e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788620373.480784:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061834368 00000100:00100000:0.0:1788620373.480793:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061834368 00000100:00100000:0.0:1788620373.481093:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788620373.481105:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+15:14305:x1875504061834368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620373.481120:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620373.481137:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd163a expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620373.481162:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd163a expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620373.481173:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd163a expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620373.481193:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519e00, rc 0) 00000100:00100000:0.0:1788620373.481287:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14305:x1875504061834368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620373.481294:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788620373.481385:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061834368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620373.481406:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620373.481415:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620373.481469:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061834496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788620373.481504:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620373.483212:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6500e8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788620373.483435:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061834496 00000100:00100000:1.0:1788620373.483446:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061834496 00000100:00100000:1.0:1788620373.483609:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788620373.483619:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14305:x1875504061834496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788620373.483644:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788620373.483664:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788620373.483670:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788620373.483788:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14305:x1875504061834496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 168us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620373.483797:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788620373.483907:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061834496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788620373.483976:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788620373.483985:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620373.483996:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620374.383551:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620375.401697:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620376.426634:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788620376.942313:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620376.942321:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788620376.942323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620376.942334:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788620376.942395:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061834624:0@lo:400:kworker.0 00000100:00100000:3.0:1788620376.942480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620376.942531:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620376.942538:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061834752:0@lo:400:kworker.0 00000100:00100000:3.0:1788620376.942570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620376.942620:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061834880:0@lo:400:kworker.0 00000100:00100000:3.0:1788620376.942646:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620376.942680:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061834624 00000100:00100000:3.0:1788620376.942697:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061834624 00000100:00100000:3.0:1788620376.942736:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788620376.942744:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3308:x1875504061834624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620376.942791:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3308:x1875504061834624:12345-0@lo:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620376.942798:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788620376.942830:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061834752 00000100:00100000:3.0:1788620376.942834:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061834752 00000100:00100000:3.0:1788620376.942858:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061834880 00000100:00100000:3.0:1788620376.942861:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061834880 00000100:00100000:3.0:1788620376.942906:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620376.942912:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061834752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620376.942956:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061834752:12345-0@lo:400:kworker.0 Request processed in 43us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620376.942962:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620376.942973:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620376.942979:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061834880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620376.943009:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061834880:12345-0@lo:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620376.943015:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788620376.943348:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6808e9c00 x1875504061834880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620376.943363:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061834880:0@lo:400:kworker.0 00010000:00080000:3.0:1788620376.943390:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6808e9180 x1875504061834752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620376.943399:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061834752:0@lo:400:kworker.0 00000100:00100000:3.0:1788620376.943417:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061834624:0@lo:400:kworker.0 00000100:00080000:2.0:1788620376.945033:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788620377.309628:0:15357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788620377.448735:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620378.473596:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620379.496966:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620380.521488:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620381.545393:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620381.960069:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788620382.063104:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620382.063111:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788620382.063114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620382.063117:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788620382.063180:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061835008:0@lo:400:kworker.0 00000100:00100000:0.0:1788620382.063275:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620382.063339:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061835136:0@lo:400:kworker.0 00000100:00100000:0.0:1788620382.063364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620382.063382:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788620382.063387:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061835264:0@lo:400:kworker.0 00000100:00100000:0.0:1788620382.063404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620382.063433:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835008 00000100:00100000:0.0:1788620382.063440:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835008 00000100:00100000:0.0:1788620382.063479:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788620382.063487:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3311:x1875504061835008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620382.063529:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3311:x1875504061835008:12345-0@lo:400:kworker.0 Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620382.063548:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788620382.063580:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835136 00000100:00100000:0.0:1788620382.063583:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835136 00000100:00100000:0.0:1788620382.063603:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835264 00000100:00100000:0.0:1788620382.063605:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835264 00000100:00100000:0.0:1788620382.063627:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620382.063633:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061835136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620382.063663:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061835136:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620382.063669:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620382.063679:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620382.063684:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061835264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620382.063706:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061835264:12345-0@lo:400:kworker.0 Request processed in 22us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620382.063711:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788620382.063732:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788620382.063765:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6804a8380 x1875504061835264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620382.063780:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061835264:0@lo:400:kworker.0 00010000:00080000:0.0:1788620382.063789:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6804a9c00 x1875504061835136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620382.063797:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061835136:0@lo:400:kworker.0 00000100:00100000:0.0:1788620382.063820:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061835008:0@lo:400:kworker.0 00010000:00010000:0.0:1788620382.576386:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620383.592458:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.622881:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620384.744351:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620369/real 1788620369] req@ffffa0d6804abb80 x1875504061831040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620384.744382:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0d6804abb80 x1875504061831040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620384.744393:0:3307:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620369/real 1788620369] req@ffffa0d6804ab100 x1875504061831168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620384 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620384.744404:0:3307:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0d6804ab100 x1875504061831168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620384 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788620384.744423:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d65141a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788620384.744443:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788620384.744447:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061831040:0@lo:8:kworker.0 00000100:00080000:3.0:1788620384.744453:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788620384.744458:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788620384.744461:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061831168:0@lo:8:kworker.0 00000100:00080000:3.0:1788620384.744529:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620384.744533:0:13334:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788620384.744535:0:13334:0:(import.c:65:import_set_state_nolock()) ffffa0d65141a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620384.744540:0:13334:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:3.0:1788620384.744544:0:13334:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788620384.744551:0:13334:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0d65141a800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:3.0:1788620384.744572:0:13334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6808e9180 x1875504061835520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788620384.744595:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620384.744598:0:13334:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788620384.744600:0:13334:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620384.744603:0:13334:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:3.0:1788620384.744606:0:13334:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788620384.744610:0:13334:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0d66a6c9800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:3.0:1788620384.744621:0:13334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6808e9c00 x1875504061835648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620384.744666:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061835392:0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.744729:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620384.744775:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620384.744802:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061835776:0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.744828:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620384.744857:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061835904:0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.745002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620384.745038:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835392 00000100:00100000:3.0:1788620384.745047:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835392 00000100:00100000:3.0:1788620384.749027:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788620384.749054:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3310:x1875504061835392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.749449:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3310:x1875504061835392:12345-0@lo:400:kworker.0 Request processed in 405us (4716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620384.749458:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788620384.749509:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835776 00000100:00100000:3.0:1788620384.749519:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835776 00000100:00100000:3.0:1788620384.749579:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835904 00000100:00100000:3.0:1788620384.749583:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835904 00000100:00100000:3.0:1788620384.749611:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620384.749617:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061835776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.749653:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061835776:12345-0@lo:400:kworker.0 Request processed in 36us (4824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620384.749659:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620384.749670:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788620384.749676:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061835904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.749711:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061835904:12345-0@lo:400:kworker.0 Request processed in 35us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620384.749716:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788620384.749743:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620384.749776:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6808ea300 x1875504061835904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788620384.750577:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6808eaa00 x1875504061835776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620384.750593:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061835776:0@lo:400:kworker.0 00000100:00100000:0.0:1788620384.750604:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061835392:0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.750955:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061835904:0@lo:400:kworker.0 00000100:00100000:3.0:1788620384.750980:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061835520:0@lo:8:kworker.0 00000100:00100000:3.0:1788620384.751037:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620384.752388:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061835648:0@lo:8:kworker.0 00000100:00100000:3.0:1788620384.752439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620384.767695:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835520 00000100:00100000:0.0:1788620384.767715:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835520 00000100:00100000:0.0:1788620384.767784:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061835648 00000100:00100000:0.0:1788620384.767788:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061835648 00000100:00100000:0.0:1788620384.767805:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620384.767815:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875504061835520:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788620384.767863:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1788620384.767908:0:14992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd1648 00002000:00100000:0.0:1788620384.767924:0:14992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0d680a2c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788620384.767928:0:14992:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788620384.767931:0:14992:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788620384.768511:0:14992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788620384.768541:0:14992:0:(import.c:65:import_set_state_nolock()) ffffa0d680a2d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620384.768633:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875504061835520:12345-0@lo:8:kworker.0 Request processed in 818us (17595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620384.768655:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788620384.768677:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620384.768682:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875504061835648:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788620384.768694:0:14992:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788620384.768722:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875504061835648:12345-0@lo:8:kworker.0 Request processed in 38us (16283us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788620384.768740:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788620384.768791:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6808e9180 x1875504061835520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620384.768804:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788620384.768815:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788620384.768823:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788620384.768829:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788620384.768831:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d65141a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788620384.768847:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788620384.768852:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061835520:0@lo:8:kworker.0 00000100:00080000:0.0:1788620384.768974:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788620384.768980:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788620384.768983:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061835648:0@lo:8:kworker.0 00000004:00080000:0.0:1788620384.769050:0:14331:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788620384.769069:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875504061836160:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788620384.769275:0:14330:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788620384.769522:0:14330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434808271024ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788620384.769604:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620384.769754:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64396ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620384.769775:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061836032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620384.769806:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620384.770693:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836160 00000100:00100000:2.0:1788620384.770705:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836160 00000100:00100000:2.0:1788620384.770763:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620384.770787:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14331:x1875504061836160:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788620384.774566:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836032 00000100:00100000:1.0:1788620384.774585:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836032 00000100:00100000:1.0:1788620384.774634:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620384.774927:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875504061836032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620384.774965:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620384.775063:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875504061836032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (5254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620384.775070:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788620384.778685:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6804a9880 x1875504061836032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620384.778714:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061836032:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1788620384.782053:0:14992:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788620384.782066:0:14992:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788620384.782073:0:14992:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788620384.794332:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620384.794349:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.794367:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788620384.794372:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620384.794380:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.794399:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.794410:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.794420:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.794440:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788620384.795048:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620384.795057:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.795079:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788620384.797232:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620384.797242:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.797275:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.797286:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.797295:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.797315:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788620384.798108:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620384.798119:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798507:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.798511:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798521:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798545:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798552:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5eb3c6/0x24857de440bd164f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798573:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.798577:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798583:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2c00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.798587:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798594:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798604:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798618:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006227da87/0x24857de440bd1656 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.798632:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.798634:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.798635:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620384.801074:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620384.802512:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.802532:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788620384.802537:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620384.802544:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.802560:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.802590:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.802598:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.802624:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620384.805392:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620384.805412:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.805429:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620384.805435:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.805448:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.805480:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.805507:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006797397e/0x24857de440bd165d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.805538:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620384.805540:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620384.805542:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620384.810530:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620384.810546:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.810564:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788620384.810569:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620384.810575:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.810590:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.810599:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.810606:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.810649:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620384.811245:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.811274:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.811284:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.811290:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.811299:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.811319:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.811326:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5b6349e/0x24857de440bd1664 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.811346:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.811347:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.811349:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788620384.813239:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788620384.814238:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.814821:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788620384.814826:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620384.814833:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.814848:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.814859:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.816005:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.816029:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620384.816047:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620384.816054:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.816063:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.816076:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.817097:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.817133:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.817142:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae66abcc/0x24857de440bd166b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.817166:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.817168:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.817170:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788620384.817183:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788620384.818681:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.819348:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.819359:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819376:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.819381:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.819388:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819402:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819413:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819420:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819445:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788620384.819814:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.819820:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819829:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.819832:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.819837:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819858:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819868:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819875:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819888:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788620384.819900:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620384.819905:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819913:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.819918:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819927:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819941:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819949:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b876d1/0x24857de440bd1672 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819972:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.819975:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819981:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.819985:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.819993:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820003:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820010:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c16e3d98/0x24857de440bd1679 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820021:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.820023:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.820024:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.820443:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.820449:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820457:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.820466:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.820470:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820479:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820487:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820493:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820507:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620384.820518:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.820521:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820526:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519a00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.820530:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820537:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820546:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820562:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093dce598/0x24857de440bd1680 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820574:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.820576:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.820578:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.820949:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.820956:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820964:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.820967:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.820971:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820980:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820988:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.820995:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821009:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620384.821016:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.821026:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821032:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.821036:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821042:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821053:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821059:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc0e08be/0x24857de440bd1687 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821071:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.821073:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.821074:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.821461:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.821467:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821476:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.821479:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.821484:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821503:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821510:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821517:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821531:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620384.821539:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.821542:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821549:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518c00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.821552:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821559:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821568:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821574:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a05171e5/0x24857de440bd168e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821593:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.821595:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.821596:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.821979:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.821985:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.821993:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.821996:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.822000:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.822008:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.822016:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.822023:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.822037:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620384.822045:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.822048:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.822066:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.822070:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.822078:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.823010:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.823019:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac5da71a/0x24857de440bd1695 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.823039:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.823041:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.823043:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.831437:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.831451:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.831468:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.831473:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.831480:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.831494:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.831514:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.831522:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.831547:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620384.832152:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620384.832161:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620384.832170:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519c00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620384.832174:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620384.832189:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620384.832209:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620384.832217:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009927f680/0x24857de440bd169c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620384.832238:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620384.832241:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620384.832242:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.833755:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.833769:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833785:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.833789:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.833796:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833809:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833818:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833826:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833856:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620384.833875:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.833880:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833887:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030a00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.833891:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833900:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833914:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833922:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c07484c/0x24857de440bd16a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.833940:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.833941:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.833942:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.834586:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.834594:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834603:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.834611:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.834615:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834625:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834633:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834640:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834656:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620384.834666:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620384.834669:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834676:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620384.834680:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834689:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834700:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834719:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008781b00c/0x24857de440bd16aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.834736:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.834738:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.834740:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.835544:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620384.845231:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620384.846484:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.846507:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1788620384.846512:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620384.846518:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.846535:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.846547:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.846556:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620384.846913:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620384.859661:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.859675:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.859694:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.859699:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.859706:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.859720:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.859731:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.859739:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.868276:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620384.868293:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.868308:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.868314:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.868325:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.868371:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.868377:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f96b983/0x24857de440bd16b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.868559:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620384.869156:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620384.869163:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.869173:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.869177:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.869186:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.869197:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.869204:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd16b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.869220:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.869222:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.869230:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620384.870467:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.870484:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.870497:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.870502:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.870508:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.870520:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.870530:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.870537:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.870554:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620384.872112:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.872124:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872137:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.872141:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.872146:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872156:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872171:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872178:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872188:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788620384.872618:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.872625:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872635:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.872638:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.872641:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872651:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872659:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872667:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.872687:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788620384.878513:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.878528:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.878545:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.878550:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.878557:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.878572:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.878584:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.878591:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.878603:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788620384.880817:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788620384.880832:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880856:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.880861:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880873:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880894:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880901:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0ad0e55/0x24857de440bd16bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880923:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788620384.880927:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880932:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.880935:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880941:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880957:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880963:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd16c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880976:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620384.880979:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880985:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.880987:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.880993:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881001:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881007:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e4f8f8/0x24857de440bd16cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881015:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620384.881018:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881029:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fe00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.881032:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881039:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881047:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881053:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd16d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.881063:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.881065:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.881066:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.881875:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.881880:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.881882:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620384.883239:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.883279:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883297:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.883309:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.883315:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883329:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883339:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883346:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883363:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620384.883814:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.883820:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883828:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.883831:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.883835:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883843:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883850:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883864:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.883879:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788620384.884299:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.884306:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884314:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.884318:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.884321:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884329:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884337:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884344:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884352:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788620384.884746:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.884752:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884766:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.884769:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.884773:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884782:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884789:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884796:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.884805:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788620384.891717:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788620384.891731:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891747:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620384.891753:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891766:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891803:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891811:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bef38cc/0x24857de440bd16db lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891835:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788620384.891839:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891846:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620384.891849:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891858:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891874:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891880:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd16e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891894:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620384.891898:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891911:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620384.891915:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891923:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891934:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891940:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cca3da6/0x24857de440bd16e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891954:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620384.891957:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891963:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620384.891967:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891974:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891984:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.891998:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd16f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.892012:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620384.892013:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620384.892015:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620384.892704:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620384.893870:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.893885:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.893903:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.893909:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.893916:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.893933:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.893943:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.893950:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.893970:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620384.904835:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.904858:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.905569:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.905574:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.905581:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.905596:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.905608:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.905616:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.906063:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788620384.907134:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620384.907148:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907161:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fa00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.907165:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907187:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907208:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907215:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c23127f/0x24857de440bd16f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907237:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620384.907241:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907246:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620384.907274:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907282:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907291:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907297:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd16fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620384.907319:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.907321:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620384.907323:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620384.910207:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620384.910222:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.910243:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1788620384.910440:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620384.910450:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.910468:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.910492:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.910500:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.910523:0:14992:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788620384.911034:0:14992:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788620384.911154:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14331:x1875504061836160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 140366us (142026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620384.911164:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788620384.911197:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620384.911203:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.911211:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2ee00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620384.911216:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.911225:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.911242:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.911832:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9ae1b2/0x24857de440bd1705 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620384.911857:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620384.911867:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620384.911869:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620384.913271:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875504061836160:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788620384.913292:0:14331:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788620384.913343:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875504061836288:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788620384.913399:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620384.913452:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67faf8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788620384.915414:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836288 00000100:00100000:1.0:1788620384.915432:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836288 00000100:00100000:1.0:1788620384.915514:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620384.915524:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14331:x1875504061836288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788620384.915583:0:14991:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1788620384.918415:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788620384.918824:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788620384.959644:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14331:x1875504061836288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44112us (46235us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788620384.959659:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620384.960418:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14331:1875504061836288:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788620384.960437:0:14331:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:01000004:0.0:1788620385.125654:0:15708:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788620385.125659:0:15708:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788620385.125787:0:15708:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0d680a29000 00000020:01000004:0.0:1788620385.125802:0:15708:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788620385.125816:0:15708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788620385.125830:0:15708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0d664e14d28) 00000020:00000080:0.0:1788620385.125845:0:15708:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788620385.153068:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788620385.153606:0:15708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788620385.154568:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788620385.154807:0:15708:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788620385.155012:0:15708:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788620385.155598:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 529: rc = 0 00100000:10000000:0.0:1788620385.155692:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 529: rc = 0 00100000:10000000:0.0:1788620385.155788:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:0.0:1788620385.158720:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 897: rc = 0 00100000:10000000:0.0:1788620385.158996:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 897: rc = 0 00100000:10000000:2.0:1788620385.159692:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 897: rc = 0 00100000:10000000:2.0:1788620385.161099:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 897: rc = 0 00100000:10000000:2.0:1788620385.161534:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 897: rc = 0 00100000:10000000:2.0:1788620385.161791:0:15708:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 897: rc = 0 00000020:00000080:2.0:1788620385.162570:0:15708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788620385.162582:0:15708:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788620385.162592:0:15708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24857de440bd1713 00000020:01000004:2.0:1788620385.162601:0:15708:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788620385.162622:0:15708:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788620385.162625:0:15708:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788620385.162631:0:15708:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788620385.162652:0:15708:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788620385.162657:0:15708:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788620385.172661:0:15708:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788620385.172698:0:15708:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.111@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788620385.172703:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788620385.172705:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788620385.172706:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620385.172707:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620385.172708:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620385.172710:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620385.172711:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620385.172717:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620385.172719:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620385.172723:0:15708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788620385.172725:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620385.172726:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788620385.172727:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620385.172728:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620385.172729:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620385.172730:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620385.172731:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620385.172732:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620385.172732:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620385.172767:0:15708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788620385.172787:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836416:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788620385.172858:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.172988:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620385.173092:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836416 00000100:00100000:0.0:1788620385.173102:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836416 00000100:00100000:0.0:1788620385.173301:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788620385.173314:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:15708:x1875504061836416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620385.173350:0:14303:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788620385.173354:0:14303:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788620385.173359:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788620385.183069:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:15708:x1875504061836416:12345-0@lo:253:mount.lustre.0 Request processed in 9749us (10202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620385.183093:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788620385.183586:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836416:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620385.183602:0:15708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788620385.183606:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620385.183607:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788620385.183608:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620385.183610:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620385.183611:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620385.183613:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620385.183614:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620385.183616:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620385.183617:0:15708:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788620385.183639:0:15708:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0d680a29000 from lustre-OST0001 10000000:01000000:2.0:1788620385.183666:0:15708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788620385.183668:0:15708:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788620385.183677:0:15708:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0d679b9b370 local copy 00010000:00010000:2.0:1788620385.183688:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620385.183990:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620385.184037:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.184132:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788620385.184239:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836544 00000100:00100000:3.0:1788620385.184320:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836544 00000100:00100000:3.0:1788620385.184413:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788620385.184423:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:15708:x1875504061836544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620385.184597:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:15708:x1875504061836544:12345-0@lo:501:mount.lustre.0 Request processed in 175us (558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788620385.184605:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788620385.184675:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836544:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788620385.184688:0:15708:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788620385.184824:0:15708:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788620385.184832:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.184841:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe2000/0x24857de440bd14c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd14c7 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620385.184873:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0d680a29000 10000000:01000000:2.0:1788620385.184878:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788620385.184883:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788620385.184886:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788620385.184890:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788620385.184893:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788620385.184914:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3600/0x24857de440bd171a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.184922:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3600/0x24857de440bd171a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.184932:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3600/0x24857de440bd171a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620385.184946:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620385.184975:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.185231:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788620385.185426:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836672 00000100:00100000:0.0:1788620385.185434:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836672 00000100:00100000:1.0:1788620385.185525:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788620385.185536:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:15708:x1875504061836672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620385.185546:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620385.185558:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd171a expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.185580:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd171a expref: 17 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.185591:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d666e2ee00/0x24857de440bd1721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd171a expref: 17 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.185599:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2ee00, rc 0) 00000100:00100000:1.0:1788620385.185641:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061836672:12345-0@lo:101:mount.lustre.0 Request processed in 109us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.185658:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788620385.185779:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620385.185792:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3600/0x24857de440bd171a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1721 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.185800:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3600/0x24857de440bd171a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd1721 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620385.186648:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788620385.187713:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620385.188140:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788620385.188415:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788620385.188453:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788620385.188504:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788620385.188540:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788620385.188571:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788620385.188638:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788620385.188646:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788620385.188735:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620385.188804:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.188953:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620385.189039:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836800 00000100:00100000:0.0:1788620385.189048:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836800 00000100:00100000:0.0:1788620385.189113:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788620385.189123:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061836800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620385.190053:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061836800:12345-0@lo:501:mount.lustre.0 Request processed in 930us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620385.190060:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788620385.190375:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620385.190426:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620385.190470:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.190548:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620385.190583:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061836928 00000100:00100000:3.0:1788620385.190590:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061836928 00000100:00100000:3.0:1788620385.190671:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788620385.190679:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061836928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620385.191107:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061836928:12345-0@lo:503:mount.lustre.0 Request processed in 428us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620385.191114:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788620385.191428:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061836928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788620385.192524:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788620385.192615:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620385.192683:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.192820:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620385.193005:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837056 00000100:00100000:3.0:1788620385.193013:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837056 00000100:00100000:3.0:1788620385.193056:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788620385.193066:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061837056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620385.193591:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061837056:12345-0@lo:502:mount.lustre.0 Request processed in 524us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620385.193599:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788620385.193692:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620385.193930:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788620385.193981:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788620385.194031:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788620385.194088:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788620385.194125:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788620385.194627:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788620385.194696:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788620385.194734:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788620385.194783:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788620385.194820:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620385.194886:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.194917:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620385.195039:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837184 00000100:00100000:0.0:1788620385.195046:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837184 00000100:00100000:0.0:1788620385.195500:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788620385.195510:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061837184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620385.195847:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061837184:12345-0@lo:502:mount.lustre.0 Request processed in 337us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620385.195855:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788620385.196043:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620385.196141:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788620385.196429:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788620385.197957:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788620385.197968:0:15709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788620385.197975:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620385.197977:0:15709:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788620385.197984:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788620385.198000:0:15709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0d664e119b8) 00000020:00000080:0.0:1788620385.198023:0:15709:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788620385.198030:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788620385.198117:0:15709:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d680a29000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788620385.198125:0:15709:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788620385.198386:0:15709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24857de440bd172f 00010000:00010000:2.0:1788620385.204123:0:15709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788620385.205450:0:15709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788620385.207981:0:15709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788620385.213056:0:15709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788620385.213070:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620385.213088:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620385.213090:0:15709:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788620385.213094:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620385.213098:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620385.213099:0:15709:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788620385.213102:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788620385.213104:0:15709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788620385.213106:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620385.213108:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620385.213117:0:15709:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788620385.213121:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620385.213124:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620385.213125:0:15709:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788620385.213128:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788620385.214032:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620385.214039:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620385.214041:0:15709:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620385.214045:0:15709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788620385.216641:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788620385.216684:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788620385.216779:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3600/0x24857de440bd171a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1721 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620385.216800:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3600/0x24857de440bd171a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1721 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620385.216809:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d680a29000 from 1 10000000:01000000:0.0:1788620385.216812:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620385.216849:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620385.216868:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620385.216881:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620385.216906:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620385.216972:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620385.217063:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d651472d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620385.223298:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837312 00000100:00100000:1.0:1788620385.223314:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837312 00000100:00100000:1.0:1788620385.223381:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788620385.223392:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:15708:x1875504061837312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620385.223410:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620385.223431:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd1736 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.223460:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd1736 expref: 18 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.223472:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1736 expref: 18 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.223480:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2e200, rc 0) 00000100:00100000:1.0:1788620385.223556:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837312:12345-0@lo:101:mount.lustre.0 Request processed in 165us (6583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.223562:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788620385.223649:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620385.223668:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.223677:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788620385.229941:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788620385.231835:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620385.232179:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788620385.232226:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788620385.232339:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788620385.232348:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788620385.232440:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620385.232506:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620385.232545:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65921be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620385.232572:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837440 00000100:00100000:1.0:1788620385.232578:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837440 00000100:00100000:1.0:1788620385.232619:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620385.232628:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620385.232819:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837440:12345-0@lo:501:mount.lustre.0 Request processed in 191us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.232826:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620385.232873:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620385.232905:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620385.232941:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620385.232954:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65921be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620385.232968:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837568 00000100:00100000:1.0:1788620385.232972:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837568 00000100:00100000:1.0:1788620385.232991:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788620385.232997:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620385.233131:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837568:12345-0@lo:503:mount.lustre.0 Request processed in 133us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.233137:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788620385.233174:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788620385.234811:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788620385.235023:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620385.235107:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620385.235242:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65921be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788620385.236674:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837696 00000100:00100000:0.0:1788620385.236686:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837696 00000100:00100000:0.0:1788620385.237315:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788620385.237328:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620385.237587:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837696:12345-0@lo:502:mount.lustre.0 Request processed in 261us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620385.238370:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620385.238677:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788620385.238749:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788620385.238796:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788620385.238834:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788620385.238881:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788620385.238930:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788620385.238979:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788620385.239010:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788620385.239049:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620385.239128:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.239164:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788620385.242567:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837824 00000100:00100000:1.0:1788620385.242585:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837824 00000100:00100000:1.0:1788620385.242628:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788620385.242637:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061837824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620385.243753:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061837824:12345-0@lo:502:mount.lustre.0 Request processed in 1111us (4619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.243764:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788620385.243993:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620385.244189:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788620385.244205:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:0.0:1788620385.244733:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000020:01000000:0.0:1788620385.253426:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620385.253440:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620385.253443:0:15713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788620385.253450:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d680a29000 00000020:00000080:0.0:1788620385.253471:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788620385.253480:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620385.253482:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620385.253483:0:15713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788620385.253486:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620385.253489:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620385.253490:0:15713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788620385.253494:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0d680a29000 00000020:00000080:0.0:1788620385.253496:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788620385.253610:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620385.253614:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620385.253615:0:15713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788620385.253618:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788620385.253620:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620385.253621:0:15713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788620385.253625:0:15713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0d680a29000 00000020:00000080:0.0:1788620385.253627:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788620385.261677:0:15713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788620385.261689:0:15713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788620385.261691:0:15713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788620385.261696:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788620385.261770:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788620385.261795:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620385.261817:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620385.261830:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620385.261888:0:15708:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788620385.261891:0:15708:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0d680a29000 10000000:01000000:0.0:1788620385.261895:0:15708:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0d680a29000 10000000:01000000:0.0:1788620385.261899:0:15708:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620385.261914:0:15708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0d680a29000 from 1 10000000:01000000:0.0:1788620385.261916:0:15708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788620385.261953:0:15708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640030a00/0x24857de440bd1744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620385.261961:0:15708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d640030a00/0x24857de440bd1744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620385.261973:0:15708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d640030a00/0x24857de440bd1744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620385.261998:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620385.262069:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620385.262126:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d651472f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620385.262965:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061837952 00000100:00100000:1.0:1788620385.262974:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061837952 00000100:00100000:1.0:1788620385.263024:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788620385.263033:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061837952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620385.263048:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620385.263060:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d666e2f200/0x24857de440bd174b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd1744 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.263094:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2f200/0x24857de440bd174b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd1744 expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.263107:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d666e2f200/0x24857de440bd174b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1744 expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.263115:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2f200, rc 0) 00000100:00100000:1.0:1788620385.263497:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061837952:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.263514:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788620385.263580:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061837952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620385.263599:0:15708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d640030a00/0x24857de440bd1744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd174b expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620385.263608:0:15708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d640030a00/0x24857de440bd1744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd174b expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788620385.267707:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788620385.269053:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620385.272945:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788620385.273034:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788620385.273081:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788620385.273425:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788620385.273471:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788620385.273520:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788620385.273558:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788620385.273591:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788620385.273651:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788620385.273688:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788620385.273722:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788620385.273772:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788620385.273826:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788620385.274977:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788620385.275070:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788620385.275120:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788620385.275517:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788620385.275591:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788620385.275640:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788620385.275677:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788620385.275754:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788620385.275790:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788620385.275825:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788620385.275889:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788620385.275927:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788620385.275963:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788620385.276009:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788620385.276046:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788620385.280912:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788620385.281025:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788620385.281062:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788620385.281114:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788620385.281974:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788620385.282051:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788620385.282099:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788620385.282159:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788620385.282503:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788620385.282625:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788620385.282633:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788620385.282773:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620385.282852:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620385.284908:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d65921ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620385.285818:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838080 00000100:00100000:0.0:1788620385.285830:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838080 00000100:00100000:0.0:1788620385.286638:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788620385.286653:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620385.288177:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838080:12345-0@lo:501:mount.lustre.0 Request processed in 1518us (5314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620385.288189:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788620385.291018:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620385.291099:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620385.293023:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620385.293141:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64396ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620385.303006:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838208 00000100:00100000:0.0:1788620385.303026:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838208 00000100:00100000:0.0:1788620385.303181:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788620385.303194:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620385.303508:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838208:12345-0@lo:503:mount.lustre.0 Request processed in 315us (10493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620385.303517:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788620385.303660:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788620385.304449:0:15708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620385.304560:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620385.304632:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620385.315741:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67faf8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788620385.321455:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838336 00000100:00100000:2.0:1788620385.321473:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838336 00000100:00100000:2.0:1788620385.321527:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788620385.321537:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d679ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620385.322531:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d679ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838336:12345-0@lo:502:mount.lustre.0 Request processed in 991us (17895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620385.322541:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788620385.322653:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620385.323358:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788620385.323436:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788620385.323465:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788620385.323520:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788620385.323551:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788620385.323587:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788620385.323613:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788620385.323638:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788620385.323678:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788620385.326007:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788620385.326094:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788620385.326681:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788620385.326748:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788620385.326775:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788620385.326818:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788620385.326848:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788620385.326893:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788620385.326968:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788620385.327002:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788620385.327033:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788620385.327104:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788620385.327143:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788620385.327972:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788620385.328046:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788620385.328089:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788620385.328118:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788620385.328432:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788620385.328473:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788620385.328508:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788620385.328554:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788620385.328589:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788620385.328621:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788620385.328655:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788620385.328745:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788620385.328782:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788620385.328826:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788620385.329515:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788620385.329565:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788620385.329617:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788620385.329654:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788620385.329754:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620385.329850:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620385.330555:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67faf8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788620385.331100:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838464 00000100:00100000:2.0:1788620385.331110:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838464 00000100:00100000:0.0:1788620385.333964:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788620385.333987:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620385.334555:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061838464:12345-0@lo:502:mount.lustre.0 Request processed in 577us (4703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620385.334564:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788620385.342185:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061838464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620385.342692:0:15708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788620385.342745:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788620385.353923:0:15718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788620385.353961:0:15718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0d5412c4d28) 00000020:00000080:0.0:1788620385.353985:0:15718:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788620385.354056:0:15718:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0d680a29000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788620385.354061:0:15718:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0d680a29000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788620385.354064:0:15718:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0d680a29000 3 00010000:00080000:0.0:1788620385.354104:0:15718:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0d649cd2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.111@tcp at head 00010000:00010000:2.0:1788620385.358509:0:15718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788620385.359994:0:15718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788620385.360043:0:15718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788620385.360059:0:15718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x24857de440bd1759 00000100:00080000:2.0:1788620385.360082:0:15718:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788620385.360089:0:15718:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0d649cd2800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:2.0:1788620385.360130:0:15718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6807dc000 x1875504061838592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788620385.360161:0:15718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788620385.360503:0:13334:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788620385.360509:0:13334:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788620385.360520:0:13334:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788620385.360525:0:13334:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:1.0:1788620385.360530:0:13334:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788620385.360535:0:13334:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0d66a6c9800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:1.0:1788620385.360552:0:13334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d680392300 x1875504061838848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788620385.360837:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061838720:0@lo:400:kworker.0 00000100:00100000:2.0:1788620385.361060:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.361117:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620385.361123:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061838976:0@lo:400:kworker.0 00000100:00100000:2.0:1788620385.361161:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620385.361323:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061838592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788620385.361594:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061839104:0@lo:400:kworker.0 00000100:00100000:1.0:1788620385.361628:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620385.361664:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838720 00000100:00100000:1.0:1788620385.361671:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838720 00000100:00100000:1.0:1788620385.364085:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620385.364103:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875504061838720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620385.364212:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875504061838720:12345-0@lo:400:kworker.0 Request processed in 116us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.364219:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620385.364671:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061838720:0@lo:400:kworker.0 00000040:00080000:2.0:1788620385.364779:0:15718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1788620385.365024:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838976 00000100:00100000:1.0:1788620385.365032:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838976 00000100:00100000:1.0:1788620385.365083:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061839104 00000100:00100000:1.0:1788620385.365086:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061839104 00000100:00100000:1.0:1788620385.365107:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620385.365115:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061838976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620385.365287:0:14308:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788620385.365299:0:14308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788620385.365319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788620385.365388:0:15708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788620385.365416:0:15708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788620385.365431:0:15708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d640030a00/0x24857de440bd1744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd174b expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.365442:0:15708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d640030a00/0x24857de440bd1744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd174b expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788620385.365498:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788620385.365500:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788620385.365501:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620385.365503:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620385.365504:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620385.365505:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620385.365507:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620385.365509:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620385.365510:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620385.365515:0:15708:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788620385.365517:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620385.365518:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788620385.365519:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620385.365520:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620385.365521:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620385.365522:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620385.365523:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620385.365524:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620385.365525:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620385.365579:0:15708:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788620385.365594:0:15708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061839232:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788620385.366685:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061838848:0@lo:8:kworker.0 00000100:00100000:1.0:1788620385.366837:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061838976:12345-0@lo:400:kworker.0 Request processed in 1721us (5673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.366847:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620385.366882:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838592 00000100:00100000:1.0:1788620385.366889:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838592 00000100:00100000:1.0:1788620385.366912:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620385.366933:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061839104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620385.367012:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061839104:12345-0@lo:400:kworker.0 Request processed in 82us (5383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.367018:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620385.367031:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620385.367035:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875504061838592:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788620385.367058:0:14310:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:1.0:1788620385.367105:0:14310:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x24857de440bd1760 00000004:00100000:1.0:1788620385.367121:0:14310:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788620385.367154:0:14310:0:(import.c:65:import_set_state_nolock()) ffffa0d679a80000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620385.367204:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875504061838592:12345-0@lo:38:llog_process_th.0 Request processed in 167us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620385.367210:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788620385.367445:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680393800 x1875504061838976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620385.367459:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061838976:0@lo:400:kworker.0 00010000:00080000:3.0:1788620385.368305:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d680392680 x1875504061839104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620385.368318:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061839104:0@lo:400:kworker.0 00000100:00100000:0.0:1788620385.372803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620385.373061:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061838848 00000100:00100000:3.0:1788620385.373082:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061838848 00000100:00100000:3.0:1788620385.373134:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620385.373143:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875504061838848:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788620385.373226:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875504061838848:12345-0@lo:8:kworker.0 Request processed in 82us (433us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788620385.373233:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620385.373800:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788620385.373811:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788620385.373815:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788620385.373819:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061838848:0@lo:8:kworker.0 00010000:00080000:0.0:1788620385.373865:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0d6807dc000 x1875504061838592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620385.373874:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788620385.373881:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788620385.373898:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788620385.373903:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788620385.373906:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d649cd2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788620385.373912:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875504061838592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788620385.377190:0:15708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620385.377427:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061839232 00000100:00100000:0.0:1788620385.377438:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061839232 00000100:00100000:0.0:1788620385.377495:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788620385.377506:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:15708:x1875504061839232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620385.377552:0:14302:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788620385.377567:0:14302:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788620385.378041:0:15708:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5840 going to sleep for 11 seconds 20000000:01000000:0.0:1788620385.439673:0:14302:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788620385.439694:0:14302:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788620385.439769:0:14324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788620385.439775:0:14324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788620385.439800:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620385.439820:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd163a expref: 19 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620385.439829:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620385.439884:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd163a expref: 19 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620385.439899:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd163a expref: 19 pid: 14302 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620385.439914:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808eb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14324:1875504061839360:0@lo:104: 00000100:00100000:3.0:1788620385.439988:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620385.440052:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67faf8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788620385.440664:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061839360 00000100:00100000:2.0:1788620385.440675:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061839360 00000100:00100000:2.0:1788620385.440736:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620385.440746:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14324:x1875504061839360:12345-0@lo:104: 00010000:00010000:2.0:1788620385.440761:0:14291:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.440823:0:14291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620385.440829:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:14324:x1875504061839360:12345-0@lo:104: Request processed in 85us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620385.440836:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620385.440976:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808eb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14324:1875504061839360:0@lo:104: 00010000:00010000:3.0:1788620385.440995:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.441319:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620385.441326:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.441334:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3a00 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620385.441338:0:14296:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.441346:0:14296:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620385.441354:0:14296:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620385.441360:0:14296:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620385.441397:0:14296:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.441404:0:14296:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620385.441436:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.441443:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3a00/0x24857de440bd163a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1641 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.441461:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620385.441463:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620385.441464:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620385.441515:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620385.441529:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061839488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620385.441567:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620385.442405:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061839488 00000100:00100000:2.0:1788620385.442413:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061839488 00010000:00010000:2.0:1788620385.442444:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd163a expref: 20 pid: 14302 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620385.442472:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620385.442480:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+20:3308:x1875504061839488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620385.442493:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620385.442498:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd163a expref: 20 pid: 14302 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442509:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd163a expref: 20 pid: 14302 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442525:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a519e00/0x24857de440bd1641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd163a expref: 20 pid: 14302 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442540:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442549:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788620385.442577:0:14295:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002803563s 00010000:00010000:2.0:1788620385.442582:0:14295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442589:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442595:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442601:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442606:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620385.442610:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442617:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442630:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620385.442638:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620385.442686:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3308:x1875504061839488:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620385.442693:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788620385.442816:0:14324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620385.442824:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620385.442831:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642e00/0x24857de440bd1767 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620385.442968:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061839488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620385.456008:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:15708:x1875504061839232:12345-0@lo:253:mount.lustre.0 Request processed in 78493us (78813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620385.456025:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788620385.456117:0:15708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:15708:1875504061839232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620385.456132:0:15708:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788620385.456147:0:15708:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620385.456149:0:15708:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788620385.456150:0:15708:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620385.456151:0:15708:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620385.456152:0:15708:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620385.456154:0:15708:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620385.456155:0:15708:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620385.456157:0:15708:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620385.456158:0:15708:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788620385.456368:0:15708:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788620385.460742:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620385.460922:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620385.461116:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620385.461558:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620385.461709:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620385.462001:0:15708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788620385.463524:0:15708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788620385.512610:0:15708:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788620385.512622:0:15708:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788620385.512660:0:15708:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788620385.512719:0:15708:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788620385.512734:0:15708:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788620385.512767:0:15708:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788620385.640473:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788620386.664344:0:14305:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788620386.664354:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0d679ecc000 from 8 10000000:01000000:3.0:1788620386.664359:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788620386.664411:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642e00/0x24857de440bd176e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620386.664424:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641642e00/0x24857de440bd176e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620386.664438:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641642e00/0x24857de440bd176e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620386.664481:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061839616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620386.664568:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620386.664626:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620386.664743:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061839616 00000100:00100000:0.0:1788620386.664752:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061839616 00000100:00100000:0.0:1788620386.664808:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788620386.664818:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:14305:x1875504061839616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620386.664833:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620386.664850:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640030c00/0x24857de440bd1775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd176e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620386.664879:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640030c00/0x24857de440bd1775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd176e expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620386.664890:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640030c00/0x24857de440bd1775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd176e expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620386.664911:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030c00, rc 0) 00000100:00100000:0.0:1788620386.664956:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061839616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620386.664963:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788620386.665064:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061839616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620386.665081:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641642e00/0x24857de440bd176e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1775 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620386.665090:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641642e00/0x24857de440bd176e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd1775 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620386.665138:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061839744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788620386.665185:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620386.665208:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620386.665329:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061839744 00000100:00100000:0.0:1788620386.665334:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061839744 00000100:00100000:0.0:1788620386.665367:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788620386.665373:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061839744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788620386.665388:0:14302:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788620386.665404:0:14302:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788620386.665408:0:14302:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788620386.665487:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061839744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620386.665494:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788620386.665570:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061839744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788620386.665626:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788620386.665633:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642e00/0x24857de440bd176e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1775 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620386.665641:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641642e00/0x24857de440bd176e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd1775 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620386.667269:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788620387.361834:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788620387.361870:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788620387.692973:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620388.718135:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620389.746794:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620390.266484:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061839872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620390.266569:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.268428:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061839872 00000100:00100000:2.0:1788620390.268439:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061839872 00000100:00100000:2.0:1788620390.268515:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620390.268526:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061839872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620390.268565:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620390.268643:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061839872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620390.268649:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788620390.271030:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620390.271091:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788620390.271125:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061839872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788620390.761162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788620390.761179:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788620390.761183:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788620390.761194:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0d66a6c9800 using connection 192.168.201.111@tcp/0@lo 00000100:00100000:2.0:1788620390.761220:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0d6807df800 x1875504061840128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788620390.761380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061840000:0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.761449:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.761505:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788620390.761511:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061840512:0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.761539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.761568:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061840128:0@lo:8:kworker.0 00000100:00100000:2.0:1788620390.761596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.761623:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061840256:0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.761645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.761677:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620390.761683:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061840384:0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.761708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.761759:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840000 00000100:00100000:2.0:1788620390.761767:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840000 00000100:00100000:2.0:1788620390.761816:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788620390.761826:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3311:x1875504061840000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.761872:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3311:x1875504061840000:12345-0@lo:400:kworker.0 Request processed in 47us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620390.761879:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788620390.762392:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840128 00000100:00100000:1.0:1788620390.762398:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840128 00000100:00100000:1.0:1788620390.762422:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620390.762427:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875504061840128:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788620390.762462:0:14989:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:1.0:1788620390.762489:0:14989:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24857de440bd177c 00002000:00100000:1.0:1788620390.762502:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0d679a81000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113955 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788620390.762507:0:14989:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788620390.762510:0:14989:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788620390.762822:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840512 00000100:00100000:1.0:1788620390.762827:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840512 00000100:00100000:1.0:1788620390.762861:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840256 00000100:00100000:1.0:1788620390.762865:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840256 00000100:00100000:1.0:1788620390.762875:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840384 00000100:00100000:1.0:1788620390.762878:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840384 00010000:00010000:3.0:1788620390.763688:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620390.765609:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788620390.765637:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061840512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620390.765740:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061840512:12345-0@lo:400:kworker.0 Request processed in 114us (4199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620390.766006:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620390.766028:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061840256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.766078:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061840256:12345-0@lo:400:kworker.0 Request processed in 53us (4432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620390.766086:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620390.766112:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620390.766119:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061840384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.766838:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875504061840384:12345-0@lo:400:kworker.0 Request processed in 717us (5125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620390.766846:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788620390.768872:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807df480 x1875504061840512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620390.768891:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061840512:0@lo:400:kworker.0 00000100:00100000:2.0:1788620390.768904:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061840000:0@lo:400:kworker.0 00000100:00080000:2.0:1788620390.768959:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620390.769034:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788620390.771089:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807dd500 x1875504061840384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620390.771104:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875504061840384:0@lo:400:kworker.0 00010000:00080000:3.0:1788620390.771117:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807dd880 x1875504061840256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620390.771127:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061840256:0@lo:400:kworker.0 00002000:00080000:3.0:1788620390.777394:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788620390.777434:0:14989:0:(import.c:65:import_set_state_nolock()) ffffa0d68030b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620390.778716:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875504061840128:12345-0@lo:8:kworker.0 Request processed in 16283us (17114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620390.778729:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788620390.782746:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807df800 x1875504061840128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788620390.782769:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788620390.782777:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788620390.782783:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788620390.782786:0:3307:0:(import.c:65:import_set_state_nolock()) ffffa0d66a6c9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788620390.782803:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788620390.782809:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875504061840128:0@lo:8:kworker.0 00000004:00080000:2.0:1788620390.782873:0:14333:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788620390.782903:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14333:1875504061840768:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788620390.782968:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.786078:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807ed3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788620390.786108:0:14332:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788620390.786618:0:14332:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440825367036ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788620390.786648:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620390.790438:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840768 00000100:00100000:3.0:1788620390.790452:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840768 00000100:00100000:2.0:1788620390.790457:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061840640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620390.790542:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620390.790597:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840640 00000100:00100000:2.0:1788620390.790601:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840640 00000100:00100000:2.0:1788620390.790666:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620390.790676:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875504061840640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620390.790714:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620390.790771:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875504061840640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620390.790778:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788620390.790800:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788620390.790870:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6807df800 x1875504061840640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620390.790892:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061840640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620390.792174:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620390.792187:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14333:x1875504061840768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788620390.798383:0:14989:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788620390.798395:0:14989:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788620390.798401:0:14989:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788620390.832937:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620390.832954:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.832973:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788620390.832987:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620390.832994:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833019:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833029:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833037:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833058:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620390.833071:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620390.833076:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833083:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640030e00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.833087:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833095:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833110:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833116:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f96b983/0x24857de440bd1783 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.833140:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.833142:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.833144:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620390.834377:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620390.834388:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.834400:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788620390.834404:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620390.834408:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.834419:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.834428:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.834436:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.834457:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620390.834471:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620390.834476:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620390.835327:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.835336:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.835348:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.835352:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.835358:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.835370:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.835390:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.835398:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.835415:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620390.836026:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.836033:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.836042:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.836045:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.836049:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.836057:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.836064:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.836071:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.836091:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788620390.836707:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.836713:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836723:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836740:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836747:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004939215/0x24857de440bd178a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836768:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620390.836772:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836778:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.836782:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836789:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836798:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.836813:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1791 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.837921:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620390.837930:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.837940:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.837943:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.837951:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.837966:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.837973:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1798 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.838002:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.838004:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.838006:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.838020:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.838679:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.838688:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.838701:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.838705:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.838710:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.838722:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.838731:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.838737:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.839041:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620390.839635:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.839642:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.839652:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.839663:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.839668:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.839678:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.839686:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.839694:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.839711:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788620390.841616:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620390.841888:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.841913:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.841919:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.841930:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.841952:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.841959:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd179f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.841996:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620390.842001:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.842008:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.842012:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.842021:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.842031:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.842046:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.842060:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.842062:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.842064:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.842072:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.843439:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.843451:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.843466:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.843471:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.843477:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.843492:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.844407:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.844426:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.844445:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620390.846693:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.846708:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.846724:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.846728:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.846734:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.846748:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.846757:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.847596:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.847617:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788620390.849744:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.849759:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.849783:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.849787:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.849794:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.849806:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.849823:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620390.849832:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.849843:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fe00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.849848:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.849860:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.849878:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.849886:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.849906:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620390.849910:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.850427:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fa00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.850431:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.850439:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.850452:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.850459:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.850474:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.850475:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.850477:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.850483:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.851387:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.851400:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.851428:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620390.851556:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620390.851563:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.853385:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620390.853391:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.853417:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.853436:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.853443:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd17bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620390.853464:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.853467:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.853468:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.855704:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.855715:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.855730:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.855734:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.855740:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.855752:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.856008:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.856015:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.856092:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620390.856599:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.856607:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.856616:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.856619:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.856624:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.856634:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.856640:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.856647:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788620390.856910:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788620390.864641:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788620390.864656:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864669:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.864674:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864685:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864725:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864732:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd17c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864771:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620390.864776:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864782:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.864786:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864793:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864805:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.864825:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.864827:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.864829:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620390.869602:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.874849:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620390.874865:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620390.875845:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.875856:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.875872:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.875877:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.875884:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.875899:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.875908:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.875916:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.875935:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620390.875948:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620390.875953:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.875969:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2ec00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620390.875983:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.875992:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.876007:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.876014:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd17d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.876029:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.876031:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.876033:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.877358:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.877368:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.877378:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.877382:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.877387:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.877397:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.877412:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.877419:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.877438:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620390.880061:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.880073:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.880089:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.880093:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.880099:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.880110:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.880119:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.880126:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.880632:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788620390.881122:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.881130:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.881140:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.883033:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.883050:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.883069:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.883081:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.883090:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883362:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788620390.883371:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883394:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fa00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.883399:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883409:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883428:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883435:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd17d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883460:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788620390.883464:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883471:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fe00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.883474:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883483:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883492:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883516:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd17de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883529:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620390.883533:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883539:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.883543:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883551:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883561:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.883568:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.883570:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.883572:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.883738:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.883925:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620390.883931:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd17e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620390.884548:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.884556:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.884573:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.884577:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.884583:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.884593:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.884603:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.884611:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.885281:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620390.885288:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.885296:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.885308:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.885317:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.885329:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.885337:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.885339:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.885341:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.885438:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620390.885444:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd17ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620390.886350:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.886359:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.886370:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.886374:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.886379:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.886403:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.886414:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.886422:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.890715:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620390.890732:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.890747:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.890752:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.890879:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.890903:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.890914:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.890928:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.890930:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.891294:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620390.891303:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd17f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.891615:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.894130:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.894153:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.894171:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.894176:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.894183:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.894199:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.894221:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.894229:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.894268:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620390.895024:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.895032:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895042:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.895044:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.895048:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895057:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895064:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895071:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895098:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788620390.895112:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620390.895118:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895126:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620390.895131:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895140:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.895273:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620390.895388:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895397:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd17fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.895416:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.895417:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.895419:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.896453:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.896463:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896474:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.896484:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.896489:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896569:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896579:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896586:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896604:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620390.896617:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620390.896621:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896629:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620390.896633:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896641:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896718:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896738:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ad0e55/0x24857de440bd1808 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.896753:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.896754:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.896756:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.897411:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.897418:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897427:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.897430:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.897435:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897443:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897452:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897460:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897473:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620390.897480:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620390.897489:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897582:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620390.897585:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897593:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897604:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897611:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529fe4c1/0x24857de440bd180f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.897625:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.897627:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.897628:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.898308:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.898315:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898324:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.898327:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.898332:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898351:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898359:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898366:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898381:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620390.898389:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620390.898392:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898399:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620390.898402:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898410:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898421:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898428:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e4f8f8/0x24857de440bd1816 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.898444:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.898445:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.898447:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.899073:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.899079:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899089:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.899092:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.899096:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899105:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899113:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899120:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899136:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620390.899288:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620390.899293:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899310:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2ec00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620390.899313:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899320:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899332:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899338:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e2e89d4/0x24857de440bd181d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.899353:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.899355:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.899356:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.900336:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.900344:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.900354:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.900357:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.900362:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.900371:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.900385:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.900393:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.900451:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620390.900604:0:15972:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620390.900611:0:15972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900619:0:15972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fe00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620390.900623:0:15972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900642:0:15972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900669:0:15972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900676:0:15972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6793868/0x24857de440bd1824 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900696:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900702:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620390.900705:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900713:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900722:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900728:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fdd2ac9/0x24857de440bd1801 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.900749:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.900751:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.901633:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.901640:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.901659:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.901664:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.901668:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.901679:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.901687:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.901694:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.902060:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620390.902067:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.902075:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fa00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.902080:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.902089:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.902101:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.902111:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.902113:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.902115:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.902275:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.902283:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.902285:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.902286:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.902395:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620390.902401:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c23127f/0x24857de440bd182b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620390.903081:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.903088:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.903099:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.903103:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.903109:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.903120:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.903129:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.903136:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.905104:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620390.905116:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.905129:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:3.0:1788620390.905134:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.905328:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788620390.905905:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.905925:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.905933:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db8c1c5d/0x24857de440bd1832 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620390.905953:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.905955:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620390.906245:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.906273:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.906292:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.906296:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.906303:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.906315:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.906325:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.906333:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.906471:0:14296:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620390.906479:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.906487:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620390.906491:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.906552:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.906564:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.906572:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.906574:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.906576:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620390.906612:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.908740:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620390.908752:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bef38cc/0x24857de440bd1839 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620390.909549:0:14989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620390.909557:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.909571:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788620390.909576:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620390.909583:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.909609:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.909619:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620390.909627:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.911041:0:15972:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620390.911053:0:15972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.911079:0:15972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e400 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620390.911084:0:15972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.911096:0:15972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.911115:0:15972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.911125:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.911127:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620390.911129:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620390.911289:0:14989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620390.911297:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2628956/0x24857de440bd1840 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620390.911579:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788620390.912639:0:14989:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788620390.913335:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14333:x1875504061840768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 121145us (130361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620390.913345:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620390.913456:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14333:1875504061840768:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788620390.913471:0:14333:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788620390.913592:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14333:1875504061840896:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788620390.913628:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620390.913722:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061840896 00000100:00100000:0.0:1788620390.913732:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061840896 00000100:00100000:3.0:1788620390.913745:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664ce9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620390.913791:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620390.913802:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14333:x1875504061840896:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788620390.913845:0:14992:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788620390.921476:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14333:x1875504061840896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7669us (7840us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788620390.921490:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788620390.923489:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14333:1875504061840896:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788620390.923566:0:14333:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:2.0:1788620391.293436:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788620391.793166:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620392.808550:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788620393.401496:0:16067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788620393.835738:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620394.856424:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620395.369116:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620395.369151:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061841024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620395.369227:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620395.369490:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841024 00000100:00100000:3.0:1788620395.369500:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841024 00000100:00100000:3.0:1788620395.369554:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620395.369571:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061841024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620395.369605:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620395.369651:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061841024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620395.369658:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788620395.371461:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620395.371521:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061841024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788620395.728501:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620395.728798:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072000 00000100:00100000:3.0:1788620395.728808:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072000 00000100:00100000:3.0:1788620395.728866:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:3.0:1788620395.728875:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875504045072000:12345-192.168.201.11@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788620395.728911:0:14301:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b0b25c6a-111e-4551-8695-63420def87ec@192.168.201.11@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1788620395.728940:0:14301:0:(genops.c:1385:class_connect()) connect: client b0b25c6a-111e-4551-8695-63420def87ec, cookie 0x24857de440bd1847 00000100:00080000:3.0:1788620395.729082:0:14301:0:(import.c:65:import_set_state_nolock()) ffffa0d68030a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620395.729148:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+5:2352:x1875504045072000:12345-192.168.201.11@tcp:250:mount.lustre.0 Request processed in 273us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620395.729156:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 75 00000100:00100000:2.0:1788620395.736049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620395.736106:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072128 00000100:00100000:3.0:1788620395.736120:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072128 00000100:00100000:3.0:1788620395.736186:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 76 00000100:00100000:3.0:1788620395.736195:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+5:13718:x1875504045072128:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788620395.736213:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620395.736231:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641643a00/0x24857de440bd184e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2676 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620395.736294:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641643a00/0x24857de440bd184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2676 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620395.736307:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641643a00/0x24857de440bd184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2676 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620395.736330:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641643a00, rc 0) 00000100:00100000:3.0:1788620395.736385:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+6:13718:x1875504045072128:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 190us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620395.736391:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 76 00000100:00100000:0.0:1788620395.749333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620395.749397:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072256 00000100:00100000:3.0:1788620395.749408:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072256 00000100:00100000:3.0:1788620395.749468:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 77 00000100:00100000:3.0:1788620395.749477:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+6:13718:x1875504045072256:12345-192.168.201.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788620395.749948:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+6:13718:x1875504045072256:12345-192.168.201.11@tcp:501:mount.lustre.0 Request processed in 469us (623us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788620395.749958:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 77 00000100:00100000:0.0:1788620395.760093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620395.760198:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072384 00000100:00100000:1.0:1788620395.760211:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072384 00000100:00100000:1.0:1788620395.760306:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 78 00000100:00100000:1.0:1788620395.760318:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+6:13718:x1875504045072384:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788620395.760337:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620395.760358:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d666e2fa00/0x24857de440bd1855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b267d expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.760412:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2fa00/0x24857de440bd1855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b267d expref: 7 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.760426:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d666e2fa00/0x24857de440bd1855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b267d expref: 7 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.760436:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2fa00, rc 0) 00000100:00100000:1.0:1788620395.760488:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+7:13718:x1875504045072384:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 172us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620395.760496:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 78 00000100:00100000:0.0:1788620395.765881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620395.766021:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072512 00000100:00100000:2.0:1788620395.766032:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072512 00000100:00100000:2.0:1788620395.766090:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:2.0:1788620395.766100:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+7:13718:x1875504045072512:12345-192.168.201.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788620395.766435:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+8:13718:x1875504045072512:12345-192.168.201.11@tcp:501:mount.lustre.0 Request processed in 335us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620395.766449:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 79 00000100:00100000:0.0:1788620395.774396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620395.774619:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072640 00000100:00100000:2.0:1788620395.774633:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072640 00000100:00100000:2.0:1788620395.774708:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 80 00000100:00100000:2.0:1788620395.774719:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+8:13718:x1875504045072640:12345-192.168.201.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788620395.775367:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+8:13718:x1875504045072640:12345-192.168.201.11@tcp:503:mount.lustre.0 Request processed in 648us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620395.775376:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 80 00000100:00100000:2.0:1788620395.779683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620395.780026:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072768 00000100:00100000:1.0:1788620395.780037:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072768 00000100:00100000:1.0:1788620395.780096:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 81 00000100:00100000:1.0:1788620395.780106:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+8:13737:x1875504045072768:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620395.780501:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+8:13737:x1875504045072768:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 395us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620395.780510:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 81 00000100:00100000:0.0:1788620395.826595:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620395.828813:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045072896 00000100:00100000:2.0:1788620395.828837:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045072896 00000100:00100000:2.0:1788620395.828912:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:2.0:1788620395.828923:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+8:13737:x1875504045072896:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788620395.829546:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+8:13737:x1875504045072896:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 622us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620395.829556:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 82 00000100:00100000:0.0:1788620395.851164:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620395.854285:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073024 00000100:00100000:1.0:1788620395.854303:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073024 00000100:00100000:1.0:1788620395.854444:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 83 00000100:00100000:1.0:1788620395.854458:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+8:13718:x1875504045073024:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788620395.854475:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620395.854496:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d666e2f000/0x24857de440bd185c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b26a7 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.854530:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2f000/0x24857de440bd185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26a7 expref: 9 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.854561:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d666e2f000/0x24857de440bd185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26a7 expref: 9 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.854571:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2f000, rc 0) 00000100:00100000:1.0:1788620395.854655:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+9:13718:x1875504045073024:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 200us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620395.854663:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 83 00000100:00100000:2.0:1788620395.858045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620395.859771:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073152 00000100:00100000:0.0:1788620395.859787:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073152 00000100:00100000:0.0:1788620395.859853:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 84 00000100:00100000:0.0:1788620395.859874:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+9:13718:x1875504045073152:12345-192.168.201.11@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788620395.859912:0:14301:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788620395.859941:0:14301:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788620395.859946:0:14301:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788620395.859949:0:14301:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788620395.859952:0:14301:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788620395.864331:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+9:13718:x1875504045073152:12345-192.168.201.11@tcp:256:mount.lustre.0 Request processed in 4457us (6287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620395.864348:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 84 00000100:00100000:2.0:1788620395.870477:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620395.870701:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073280 00000100:00100000:1.0:1788620395.870713:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073280 00000100:00100000:1.0:1788620395.870773:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 85 00000100:00100000:1.0:1788620395.870783:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6465eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+9:13718:x1875504045073280:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788620395.870801:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620395.870818:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b26ae expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.870859:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.870871:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620395.870881:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2e800, rc 0) 00000100:00100000:1.0:1788620395.870972:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6465eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+10:13718:x1875504045073280:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 190us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620395.870980:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 85 00000100:00100000:1.0:1788620395.875423:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620395.876195:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073408 00000100:00100000:0.0:1788620395.876208:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073408 00000100:00100000:0.0:1788620395.876348:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 86 00000100:00100000:0.0:1788620395.876359:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6465e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+10:13718:x1875504045073408:12345-192.168.201.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788620395.876667:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6465e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+10:13718:x1875504045073408:12345-192.168.201.11@tcp:501:mount.lustre.0 Request processed in 308us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620395.876693:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 86 00000100:00100000:3.0:1788620395.880597:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788620395.880619:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061841152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620395.880692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620395.880753:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841152 00000100:00100000:3.0:1788620395.880760:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841152 00000100:00100000:3.0:1788620395.880809:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620395.880816:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875504061841152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620395.880859:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620395.880909:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875504061841152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620395.880916:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788620395.880933:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620395.880963:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061841152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620395.883626:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061841280:0@lo:400:kworker.0 00000100:00100000:3.0:1788620395.883811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620395.883921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620395.884661:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620395.884697:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061841408:0@lo:400:kworker.0 00000100:00100000:3.0:1788620395.884732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620395.884764:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061841664:0@lo:400:kworker.0 00000100:00100000:3.0:1788620395.884790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620395.884807:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788620395.884812:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061841536:0@lo:400:kworker.0 00000100:00100000:3.0:1788620395.884842:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620395.885419:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841408 00000100:00100000:2.0:1788620395.885428:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841408 00000100:00100000:2.0:1788620395.885473:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841664 00000100:00100000:2.0:1788620395.885476:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841664 00000100:00100000:2.0:1788620395.885498:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841536 00000100:00100000:2.0:1788620395.885500:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841536 00000100:00100000:2.0:1788620395.885518:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620395.885537:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061841408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620395.885727:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875504061841408:12345-0@lo:400:kworker.0 Request processed in 190us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620395.885736:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620395.885756:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620395.885762:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061841664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620395.885799:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875504061841664:12345-0@lo:400:kworker.0 Request processed in 38us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620395.885805:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620395.885815:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788620395.885822:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061841536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620395.885927:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875504061841536:12345-0@lo:400:kworker.0 Request processed in 105us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620395.885933:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788620395.885954:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788620395.885990:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6808e8380 x1875504061841408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620395.886005:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875504061841408:0@lo:400:kworker.0 00000100:00100000:1.0:1788620395.887662:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841280 00000100:00100000:1.0:1788620395.887688:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841280 00000100:00100000:0.0:1788620395.890345:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073536 00000100:00100000:0.0:1788620395.890358:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073536 00010000:00080000:3.0:1788620395.890479:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6808e8e00 x1875504061841536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620395.890498:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875504061841536:0@lo:400:kworker.0 00010000:00080000:3.0:1788620395.890512:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0d6808e9180 x1875504061841664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620395.890520:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875504061841664:0@lo:400:kworker.0 00010000:00010000:1.0:1788620395.895677:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620395.895746:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788620395.895759:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6465e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3310:x1875504061841280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620395.896682:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6465e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3310:x1875504061841280:12345-0@lo:400:kworker.0 Request processed in 924us (12868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620395.896692:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788620395.896798:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061841280:0@lo:400:kworker.0 00000100:00100000:0.0:1788620395.907287:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 88 00000100:00100000:0.0:1788620395.907301:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+10:13718:x1875504045073536:12345-192.168.201.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788620395.907727:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+10:13718:x1875504045073536:12345-192.168.201.11@tcp:503:mount.lustre.0 Request processed in 427us (23806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620395.907735:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 88 00000100:00100000:3.0:1788620395.915004:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620395.919514:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073664 00000100:00100000:3.0:1788620395.919533:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073664 00000100:00100000:3.0:1788620395.919634:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 89 00000100:00100000:3.0:1788620395.919767:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+10:13743:x1875504045073664:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620395.920084:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+10:13743:x1875504045073664:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 440us (5090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620395.920093:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 89 00000100:00100000:1.0:1788620395.934331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620395.934499:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073792 00000100:00100000:3.0:1788620395.934514:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073792 00000100:00100000:3.0:1788620395.934591:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 90 00000100:00100000:3.0:1788620395.934604:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+10:13743:x1875504045073792:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620395.934947:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+10:13743:x1875504045073792:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 344us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620395.934957:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 90 00000100:00100000:3.0:1788620395.943706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620395.943791:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045073920 00000100:00100000:2.0:1788620395.943805:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045073920 00000100:00100000:2.0:1788620395.943866:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:2.0:1788620395.943875:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875504045073920:12345-192.168.201.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788620395.943921:0:14309:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a@192.168.201.11@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:2.0:1788620395.944008:0:14309:0:(genops.c:1385:class_connect()) connect: client 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a, cookie 0x24857de440bd186a 00000004:00100000:2.0:1788620395.944047:0:14309:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788620395.944054:0:14309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788620396.001320:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788620396.001375:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1788620396.028732:0:14309:0:(import.c:65:import_set_state_nolock()) ffffa0d541ff6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620396.028835:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:2352:x1875504045073920:12345-192.168.201.11@tcp:38:mount.lustre.0 Request processed in 84958us (85142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.028846:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:3.0:1788620396.037795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620396.037848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620396.037987:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074048 00000100:00100000:2.0:1788620396.037998:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074048 00000100:00100000:2.0:1788620396.038073:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074176 00000100:00100000:2.0:1788620396.038077:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074176 00000100:00100000:2.0:1788620396.038102:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620396.038112:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:0:x1875504045074048:12345-192.168.201.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788620396.038167:0:15720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788620396.038281:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:0:x1875504045074048:12345-192.168.201.11@tcp:41:mount.lustre.0 Request processed in 135us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.038290:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620396.038310:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:2.0:1788620396.038317:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13718:x1875504045074176:12345-192.168.201.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788620396.038328:0:15720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788620396.038349:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13718:x1875504045074176:12345-192.168.201.11@tcp:41:mount.lustre.0 Request processed in 33us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.038355:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00080000:3.0:1788620396.038646:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620396.042531:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620396.042799:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074304 00000100:00100000:2.0:1788620396.042811:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074304 00000100:00100000:2.0:1788620396.043069:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:2.0:1788620396.043098:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13718:x1875504045074304:12345-192.168.201.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788620396.043391:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13718:x1875504045074304:12345-192.168.201.11@tcp:40:mount.lustre.0 Request processed in 295us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.043399:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:3.0:1788620396.047015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620396.047051:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620396.047282:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074432 00000100:00100000:2.0:1788620396.047294:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074432 00000100:00100000:2.0:1788620396.047327:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074560 00000100:00100000:2.0:1788620396.047329:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074560 00000100:00100000:2.0:1788620396.047341:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:2.0:1788620396.047349:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875504045074432:12345-192.168.201.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788620396.047379:0:14991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a@192.168.201.11@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1788620396.047408:0:14991:0:(genops.c:1385:class_connect()) connect: client 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a, cookie 0x24857de440bd1871 00002000:00100000:2.0:1788620396.047418:0:14991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a/ffffa0d541ff4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788620396.047429:0:14991:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788620396.047753:0:14991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788620396.047781:0:14991:0:(import.c:65:import_set_state_nolock()) ffffa0d67a7e4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620396.047852:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:2352:x1875504045074432:12345-192.168.201.11@tcp:8:mount.lustre.0 Request processed in 502us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.047860:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:2.0:1788620396.047878:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:2.0:1788620396.047883:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875504045074560:12345-192.168.201.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788620396.047909:0:14991:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a@192.168.201.11@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1788620396.047924:0:14991:0:(genops.c:1385:class_connect()) connect: client 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a, cookie 0x24857de440bd1878 00002000:00100000:2.0:1788620396.047930:0:14991:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a/ffffa0d67a7e7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788620396.047948:0:14991:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788620396.048422:0:14991:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788620396.048440:0:14991:0:(import.c:65:import_set_state_nolock()) ffffa0d67a7e1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620396.048475:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:2352:x1875504045074560:12345-192.168.201.11@tcp:8:mount.lustre.0 Request processed in 591us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.048483:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:3.0:1788620396.053087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620396.053229:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074688 00000100:00100000:0.0:1788620396.053241:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074688 00000100:00100000:0.0:1788620396.053324:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:0.0:1788620396.053337:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13718:x1875504045074688:12345-192.168.201.11@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788620396.056414:0:14311:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2997us 00000004:00200000:2.0:1788620396.081405:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1788620396.084214:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13718:x1875504045074688:12345-192.168.201.11@tcp:33:mount.lustre.0 Request processed in 30865us (31126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.084236:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:3.0:1788620396.370387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620396.370630:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074816 00000100:00100000:0.0:1788620396.370642:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074816 00000100:00100000:0.0:1788620396.370775:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:0.0:1788620396.370787:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13764:x1875504045074816:12345-192.168.201.11@tcp:101:mkdir.0 00010000:00010000:0.0:1788620396.370808:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620396.371017:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd187f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b26d8 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620396.371097:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1886 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620396.371353:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620396.371372:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620396.373194:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788620396.373204:0:14308:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620396.373345:0:14308:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620396.373390:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640030e00/0x24857de440bd187f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26d8 expref: 8 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620396.373492:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1886 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26d8 expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620396.373502:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620396.373506:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620396.373510:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031800, rc 0) 00000100:00100000:2.0:1788620396.373725:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:13764:x1875504045074816:12345-192.168.201.11@tcp:101:mkdir.0 Request processed in 2938us (3346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620396.373735:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00010000:00010000:0.0:1788620396.905211:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788620397.470740:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a 00010000:00010000:3.0:1788620397.928495:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620398.797148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620398.797325:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045074944 00000100:00100000:0.0:1788620398.797336:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045074944 00000100:00100000:0.0:1788620398.797519:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620398.797530:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:13817:x1875504045074944:12345-192.168.201.11@tcp:41:lfs.0 00000004:00000024:0.0:1788620398.797570:0:14309:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788620398.797718:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:13817:x1875504045074944:12345-192.168.201.11@tcp:41:lfs.0 Request processed in 189us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620398.797727:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00080000:3.0:1788620398.801560:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620398.803125:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620398.803221:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075072 00000100:00100000:3.0:1788620398.803231:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075072 00000100:00100000:3.0:1788620398.803442:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:3.0:1788620398.803453:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:13817:x1875504045075072:12345-192.168.201.11@tcp:13:lfs.0 00002000:00000024:3.0:1788620398.803494:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620398.803586:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:13817:x1875504045075072:12345-192.168.201.11@tcp:13:lfs.0 Request processed in 134us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620398.803594:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00080000:2.0:1788620398.804777:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620398.809562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620398.809684:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075200 00000100:00100000:3.0:1788620398.809694:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075200 00000100:00100000:3.0:1788620398.809774:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:3.0:1788620398.809786:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13817:x1875504045075200:12345-192.168.201.11@tcp:13:lfs.0 00002000:00000024:3.0:1788620398.809856:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788620398.810058:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620398.810200:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:13817:x1875504045075200:12345-192.168.201.11@tcp:13:lfs.0 Request processed in 415us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620398.810208:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00010000:00010000:1.0:1788620398.952971:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620398.958005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620398.958113:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075328 00000100:00100000:3.0:1788620398.958124:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075328 00000100:00100000:0.0:1788620398.959123:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 91 00000100:00100000:0.0:1788620398.959139:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+10:13844:x1875504045075328:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788620398.959157:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620398.959175:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640030e00/0x24857de440bd188d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b26df expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620398.959205:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640030e00/0x24857de440bd188d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26df expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620398.959216:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640030e00/0x24857de440bd188d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26df expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620398.959241:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640030e00, rc 0) 00000100:00100000:0.0:1788620398.959326:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+11:13844:x1875504045075328:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 192us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620398.959334:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 91 00000100:00100000:1.0:1788620398.973451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620398.973708:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075456 00000100:00100000:3.0:1788620398.973718:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075456 00000100:00100000:3.0:1788620398.973773:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 92 00000100:00100000:3.0:1788620398.973784:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+11:13844:x1875504045075456:12345-192.168.201.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788620398.974288:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+11:13844:x1875504045075456:12345-192.168.201.11@tcp:501:mount.lustre.0 Request processed in 504us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620398.974296:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 92 00000100:00100000:1.0:1788620398.982897:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620398.983903:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075584 00000100:00100000:2.0:1788620398.983918:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075584 00000100:00100000:2.0:1788620398.986702:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 93 00000100:00100000:2.0:1788620398.986726:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+11:13844:x1875504045075584:12345-192.168.201.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788620398.990869:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+11:13844:x1875504045075584:12345-192.168.201.11@tcp:503:mount.lustre.0 Request processed in 4136us (7962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620398.990888:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 93 00000100:00100000:1.0:1788620398.993891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620398.993966:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075712 00000100:00100000:3.0:1788620398.993975:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075712 00000100:00100000:3.0:1788620398.994036:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 94 00000100:00100000:3.0:1788620398.994045:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+11:13851:x1875504045075712:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620398.994400:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+11:13851:x1875504045075712:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 356us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620398.994409:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 94 00000100:00100000:1.0:1788620399.017728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620399.018100:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075840 00000100:00100000:2.0:1788620399.018111:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075840 00000100:00100000:2.0:1788620399.018171:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 95 00000100:00100000:2.0:1788620399.018181:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+11:13851:x1875504045075840:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788620399.018487:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+11:13851:x1875504045075840:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 306us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620399.018495:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 95 00000100:00100000:1.0:1788620399.031230:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620399.031358:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045075968 00000100:00100000:0.0:1788620399.031368:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045075968 00000100:00100000:0.0:1788620399.031429:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 96 00000100:00100000:0.0:1788620399.031440:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+11:13844:x1875504045075968:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788620399.031460:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620399.031479:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d640031e00/0x24857de440bd1894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2709 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620399.031509:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d640031e00/0x24857de440bd1894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2709 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620399.031521:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d640031e00/0x24857de440bd1894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2709 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620399.031530:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031e00, rc 0) 00000100:00100000:0.0:1788620399.031590:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+12:13844:x1875504045075968:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 152us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620399.031598:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 96 00000100:00100000:1.0:1788620399.044652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620399.044724:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076096 00000100:00100000:3.0:1788620399.044734:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076096 00000100:00100000:3.0:1788620399.044787:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 97 00000100:00100000:3.0:1788620399.044797:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+12:13844:x1875504045076096:12345-192.168.201.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788620399.044823:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788620399.044869:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788620399.044874:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788620399.044878:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788620399.044880:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788620399.048881:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+12:13844:x1875504045076096:12345-192.168.201.11@tcp:256:mount.lustre.0 Request processed in 4065us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620399.048898:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 97 00000100:00100000:1.0:1788620399.057188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620399.057307:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076224 00000100:00100000:2.0:1788620399.057317:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076224 00000100:00100000:2.0:1788620399.057373:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 98 00000100:00100000:2.0:1788620399.057383:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+12:13844:x1875504045076224:12345-192.168.201.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788620399.057399:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620399.057416:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2710 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.057444:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 13 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.057476:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 13 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.057485:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2400, rc 0) 00000100:00100000:2.0:1788620399.057540:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+13:13844:x1875504045076224:12345-192.168.201.11@tcp:101:mount.lustre.0 Request processed in 158us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620399.057547:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 98 00000100:00100000:1.0:1788620399.066388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620399.066472:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076352 00000100:00100000:3.0:1788620399.066482:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076352 00000100:00100000:3.0:1788620399.066589:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 99 00000100:00100000:3.0:1788620399.066598:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:13844:x1875504045076352:12345-192.168.201.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788620399.067846:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:13844:x1875504045076352:12345-192.168.201.11@tcp:501:mount.lustre.0 Request processed in 1235us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620399.067857:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 99 00000100:00100000:1.0:1788620399.082152:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620399.085773:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076480 00000100:00100000:0.0:1788620399.085790:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076480 00000100:00100000:0.0:1788620399.085941:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 100 00000100:00100000:0.0:1788620399.085952:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+13:13844:x1875504045076480:12345-192.168.201.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788620399.087794:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+13:13844:x1875504045076480:12345-192.168.201.11@tcp:503:mount.lustre.0 Request processed in 1835us (5644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620399.087806:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 100 00000100:00100000:1.0:1788620399.091091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620399.091755:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076608 00000100:00100000:2.0:1788620399.091765:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076608 00000100:00100000:3.0:1788620399.091840:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 101 00000100:00100000:3.0:1788620399.091854:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:13858:x1875504045076608:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620399.092155:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:13858:x1875504045076608:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 304us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620399.092164:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 101 00000100:00100000:1.0:1788620399.103556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620399.103646:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076736 00000100:00100000:3.0:1788620399.103656:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076736 00000100:00100000:3.0:1788620399.103713:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 102 00000100:00100000:3.0:1788620399.103723:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:13858:x1875504045076736:12345-192.168.201.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620399.104690:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:13858:x1875504045076736:12345-192.168.201.11@tcp:502:llog_process_th.0 Request processed in 963us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620399.104701:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 102 00000100:00100000:1.0:1788620399.117161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620399.117410:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076864 00000100:00100000:2.0:1788620399.117420:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076864 00000100:00100000:2.0:1788620399.117465:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:2.0:1788620399.117473:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875504045076864:12345-192.168.201.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788620399.117502:0:14310:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f1ac873d-065b-4d03-9429-b25a5a081ce1@192.168.201.11@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1788620399.117542:0:14310:0:(genops.c:1385:class_connect()) connect: client f1ac873d-065b-4d03-9429-b25a5a081ce1, cookie 0x24857de440bd18a2 00000004:00100000:2.0:1788620399.117574:0:14310:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788620399.117708:0:14310:0:(import.c:65:import_set_state_nolock()) ffffa0d649f4b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620399.117782:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:2352:x1875504045076864:12345-192.168.201.11@tcp:38:mount.lustre.0 Request processed in 308us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620399.117791:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:1.0:1788620399.120729:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620399.120789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620399.120894:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045076992 00000100:00100000:0.0:1788620399.120906:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045076992 00000100:00100000:0.0:1788620399.120984:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045077120 00000100:00100000:0.0:1788620399.120988:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045077120 00000100:00100000:0.0:1788620399.121015:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:0.0:1788620399.121025:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+7:0:x1875504045076992:12345-192.168.201.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788620399.121071:0:14309:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788620399.121143:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+7:0:x1875504045076992:12345-192.168.201.11@tcp:41:mount.lustre.0 Request processed in 118us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620399.121151:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:0.0:1788620399.121169:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:0.0:1788620399.121176:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:13844:x1875504045077120:12345-192.168.201.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788620399.121189:0:14309:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788620399.121223:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:13844:x1875504045077120:12345-192.168.201.11@tcp:41:mount.lustre.0 Request processed in 48us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620399.121230:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00080000:3.0:1788620399.121466:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620399.123477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620399.123562:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045077248 00000100:00100000:0.0:1788620399.123570:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045077248 00000100:00100000:0.0:1788620399.123664:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:0.0:1788620399.123673:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:13844:x1875504045077248:12345-192.168.201.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788620399.123742:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:13844:x1875504045077248:12345-192.168.201.11@tcp:40:mount.lustre.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620399.123766:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:1.0:1788620399.127070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620399.127158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620399.127187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620399.127322:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045077376 00000100:00100000:0.0:1788620399.127333:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045077376 00000100:00100000:0.0:1788620399.127376:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045077504 00000100:00100000:0.0:1788620399.127379:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045077504 00000100:00100000:0.0:1788620399.127392:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620399.127400:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875504045077376:12345-192.168.201.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788620399.127432:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f1ac873d-065b-4d03-9429-b25a5a081ce1@192.168.201.11@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1788620399.127467:0:14992:0:(genops.c:1385:class_connect()) connect: client f1ac873d-065b-4d03-9429-b25a5a081ce1, cookie 0x24857de440bd18a9 00002000:00100000:0.0:1788620399.127481:0:14992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f1ac873d-065b-4d03-9429-b25a5a081ce1/ffffa0d543092800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788620399.127491:0:14992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788620399.127736:0:14992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788620399.127767:0:14992:0:(import.c:65:import_set_state_nolock()) ffffa0d543094800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620399.127840:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:2352:x1875504045077376:12345-192.168.201.11@tcp:8:mount.lustre.0 Request processed in 429us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620399.127849:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620399.127878:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:0.0:1788620399.127883:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875504045077504:12345-192.168.201.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788620399.127897:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f1ac873d-065b-4d03-9429-b25a5a081ce1@192.168.201.11@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1788620399.127912:0:14992:0:(genops.c:1385:class_connect()) connect: client f1ac873d-065b-4d03-9429-b25a5a081ce1, cookie 0x24857de440bd18b0 00002000:00100000:0.0:1788620399.127917:0:14992:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f1ac873d-065b-4d03-9429-b25a5a081ce1/ffffa0d543091000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113955 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788620399.127922:0:14992:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788620399.127977:0:14992:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788620399.128023:0:14992:0:(import.c:65:import_set_state_nolock()) ffffa0d67efec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620399.128055:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:2352:x1875504045077504:12345-192.168.201.11@tcp:8:mount.lustre.0 Request processed in 169us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620399.128061:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:2.0:1788620399.129787:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045077632 00000100:00100000:2.0:1788620399.129800:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045077632 00000100:00100000:2.0:1788620399.130089:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:2.0:1788620399.130101:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:13844:x1875504045077632:12345-192.168.201.11@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788620399.130429:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1788620399.130589:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:13844:x1875504045077632:12345-192.168.201.11@tcp:33:mount.lustre.0 Request processed in 491us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620399.130597:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:1.0:1788620399.380078:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620399.380182:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045077760 00000100:00100000:2.0:1788620399.380201:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045077760 00000100:00100000:2.0:1788620399.380288:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:2.0:1788620399.380300:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:13879:x1875504045077760:12345-192.168.201.11@tcp:101:mkdir.0 00010000:00010000:2.0:1788620399.380321:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620399.380342:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd18b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b273a expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.380642:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.380655:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.380670:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620399.381002:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788620399.381007:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620399.381100:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.381130:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd18b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 8 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.381148:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 7 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620399.381169:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620399.381172:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620399.381175:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2c00, rc 0) 00000100:00100000:2.0:1788620399.381476:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+7:13879:x1875504045077760:12345-192.168.201.11@tcp:101:mkdir.0 Request processed in 1177us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620399.381485:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 14 00010000:00010000:0.0:1788620399.976984:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620400.499390:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620400.499417:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061841792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620400.499650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620400.499712:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841792 00000100:00100000:3.0:1788620400.499720:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841792 00000100:00100000:3.0:1788620400.499771:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788620400.499779:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061841792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620400.499824:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620400.499873:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061841792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620400.499928:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788620400.499951:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620400.499986:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061841792:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620401.000608:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620401.005271:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061841920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620401.005335:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620401.005400:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061841920 00000100:00100000:3.0:1788620401.005406:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061841920 00000100:00100000:3.0:1788620401.005454:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788620401.005462:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061841920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620401.005495:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620401.005531:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061841920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620401.005538:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788620401.005557:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620401.005578:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788620401.005608:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061841920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620401.012917:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061842048:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620401.013061:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061842560:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013092:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620401.013120:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620401.013126:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061842176:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620401.013182:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061842432:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013207:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620401.013225:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788620401.013230:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061842304:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620401.013306:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842048 00000100:00100000:2.0:1788620401.013314:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842048 00000100:00100000:2.0:1788620401.013359:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788620401.013368:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3308:x1875504061842048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013418:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3308:x1875504061842048:12345-0@lo:400:kworker.0 Request processed in 51us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620401.013439:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788620401.013473:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842560 00000100:00100000:2.0:1788620401.013478:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842560 00000100:00100000:2.0:1788620401.013511:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842432 00000100:00100000:2.0:1788620401.013514:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842432 00000100:00100000:2.0:1788620401.013527:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842304 00000100:00100000:2.0:1788620401.013530:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842304 00000100:00100000:2.0:1788620401.013543:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788620401.013549:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061842560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013594:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875504061842560:12345-0@lo:400:kworker.0 Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620401.013601:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788620401.013615:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620401.013622:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061842432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013655:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061842432:12345-0@lo:400:kworker.0 Request processed in 34us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620401.013661:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620401.013673:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620401.013680:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061842304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013706:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875504061842304:12345-0@lo:400:kworker.0 Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620401.013712:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620401.013730:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842176 00000100:00100000:2.0:1788620401.013734:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842176 00000100:00100000:2.0:1788620401.013767:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620401.013774:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061842176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013827:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061842176:12345-0@lo:400:kworker.0 Request processed in 53us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620401.013834:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620401.013885:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061842176:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013897:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3308:1875504061842048:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013908:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875504061842560:0@lo:400:kworker.0 00000100:00080000:2.0:1788620401.013934:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620401.013954:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875504061842304:0@lo:400:kworker.0 00000100:00100000:2.0:1788620401.013962:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061842432:0@lo:400:kworker.0 00000001:00100000:3.0:1788620401.161718:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f1ac873d-065b-4d03-9429-b25a5a081ce1 00000001:00100000:3.0:1788620401.161758:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a 00000001:00100000:2.0:1788620401.165917:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f1ac873d-065b-4d03-9429-b25a5a081ce1 00000001:00100000:2.0:1788620401.165931:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a 00000040:00080000:1.0:1788620401.512987:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788620402.024389:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788620402.609134:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1ac873d-065b-4d03-9429-b25a5a081ce1 00010000:00010000:3.0:1788620403.049650:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620403.072831:0:16272:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788620404.076130:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620404.553362:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620404.553454:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620404.553478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620404.553496:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620404.553515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620404.553547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620404.553567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620404.553591:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078144 00000100:00100000:1.0:1788620404.553602:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078144 00000100:00100000:1.0:1788620404.553658:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078656 00000100:00100000:1.0:1788620404.553662:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078656 00000100:00100000:1.0:1788620404.553676:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078272 00000100:00100000:1.0:1788620404.553679:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078272 00000100:00100000:1.0:1788620404.553691:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078528 00000100:00100000:1.0:1788620404.553694:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078528 00000100:00100000:1.0:1788620404.553710:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:1.0:1788620404.553720:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045078144:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620404.553810:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045078144:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620404.553818:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:1.0:1788620404.553843:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:1.0:1788620404.553849:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045078656:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620404.553893:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045078656:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 44us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620404.553899:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:1.0:1788620404.553922:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:1.0:1788620404.553928:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045078272:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620404.553951:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045078272:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620404.553957:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:1.0:1788620404.553968:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:1.0:1788620404.553974:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045078528:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:1.0:1788620404.553996:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045078528:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 22us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620404.554001:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:1.0:1788620404.554518:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078400 00000100:00100000:1.0:1788620404.554525:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078400 00000100:00100000:1.0:1788620404.554676:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078016 00000100:00100000:1.0:1788620404.554680:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078016 00000100:00100000:2.0:1788620404.555357:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045077888 00000100:00100000:2.0:1788620404.555363:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045077888 00000100:00100000:2.0:1788620404.555399:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 104 00000100:00100000:2.0:1788620404.555409:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:2356:x1875504045077888:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:2.0:1788620404.555466:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:2356:x1875504045077888:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 58us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620404.555473:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 104 00000100:00080000:0.0:1788620404.557720:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620404.557729:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620404.557732:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620404.558567:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:3.0:1788620404.558709:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:2356:x1875504045078400:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620404.558807:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:2356:x1875504045078400:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 230us (5328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620404.558815:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:3.0:1788620404.558839:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:3.0:1788620404.558846:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:2356:x1875504045078016:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620404.558887:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:2356:x1875504045078016:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 41us (5370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620404.558893:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 20 00010000:00010000:1.0:1788620405.097365:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620405.620075:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061842688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620405.620152:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620405.620345:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842688 00000100:00100000:0.0:1788620405.620353:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842688 00000100:00100000:0.0:1788620405.620423:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620405.620433:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6808e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061842688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620405.620467:0:14993:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788620405.620536:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620405.630488:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6808e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061842688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10042us (10321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620405.630506:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620405.634037:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061842688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620406.121582:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061842944:0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.121654:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620406.121736:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061843456:0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.121763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620406.121789:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788620406.121795:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061842816:0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.121822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620406.121844:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061843328:0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.121864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620406.121905:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061843456 00000100:00100000:2.0:1788620406.121912:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061843456 00000100:00100000:2.0:1788620406.121963:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061843328 00000100:00100000:2.0:1788620406.121966:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061843328 00000100:00100000:2.0:1788620406.121987:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788620406.121996:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061843456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.122049:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875504061843456:12345-0@lo:400:kworker.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620406.122056:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788620406.122204:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788620406.122211:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061843328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.122240:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875504061843328:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620406.122246:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788620406.122286:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842816 00000100:00100000:2.0:1788620406.122290:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842816 00000100:00100000:2.0:1788620406.122311:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788620406.122318:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3311:x1875504061842816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.122346:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3311:x1875504061842816:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620406.122360:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788620406.122409:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3311:1875504061842816:0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.122422:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875504061843328:0@lo:400:kworker.0 00000100:00100000:2.0:1788620406.122430:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875504061843456:0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.122564:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061843200:0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.122593:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620406.122613:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620406.122625:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061843072:0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.122650:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620406.122676:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061842944 00000100:00100000:1.0:1788620406.122680:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061842944 00000100:00100000:1.0:1788620406.122705:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061843072 00000100:00100000:1.0:1788620406.122721:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061843072 00000100:00100000:1.0:1788620406.122740:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620406.122746:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6807dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061842944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.122782:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6807dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875504061842944:12345-0@lo:400:kworker.0 Request processed in 36us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620406.122788:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620406.122800:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788620406.122805:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061843072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.122835:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061843072:12345-0@lo:400:kworker.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620406.122841:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788620406.122855:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788620406.122860:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620406.122868:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061843200 00000100:00100000:1.0:1788620406.122871:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061843200 00000100:00100000:1.0:1788620406.122905:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620406.122912:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061843200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.122939:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875504061843200:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620406.122945:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620406.122973:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061843072:0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.122982:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6807dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875504061843200:0@lo:400:kworker.0 00000100:00100000:1.0:1788620406.123016:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6808e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875504061842944:0@lo:400:kworker.0 00010000:00010000:0.0:1788620406.123201:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620406.130405:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061843584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620406.130483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620406.130590:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061843584 00000100:00100000:3.0:1788620406.130600:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061843584 00000100:00100000:3.0:1788620406.130648:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620406.130658:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061843584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620406.130702:0:14994:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620406.130766:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061843584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620406.130773:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788620406.135759:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061843584:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788620406.356724:0:16420:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf004deb0 20000000:00000080:0.0:1788620406.356743:0:16420:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0d54339e000 uarg=0000000000000000 20000000:01000000:0.0:1788620406.356782:0:16420:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788620406.356788:0:16420:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788620406.356792:0:16420:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788620406.357627:0:16421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788620406.357862:0:16420:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788620406.366398:0:16420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788620406.366564:0:16420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366604:0:16420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd15b5 expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366612:0:16420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1602 expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366619:0:16420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd1736 expref: 18 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366628:0:16420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366634:0:16420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366641:0:16420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366771:0:16420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366785:0:16420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 12 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.366800:0:16420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061843712:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620406.366955:0:16420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.366964:0:16420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 12 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.366980:0:16420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061843840:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620406.367010:0:16420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd1736 expref: 18 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.367017:0:16420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd1736 expref: 18 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.367026:0:16420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061843968:0@lo:104: 00000100:00100000:3.0:1788620406.367080:0:16420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620406.367125:0:16420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd1602 expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.367133:0:16420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd1602 expref: 18 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.367140:0:16420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061844096:0@lo:104: 00000100:00100000:3.0:1788620406.367159:0:16420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788620406.367182:0:16420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24857de440bd15b5 expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.367190:0:16420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24857de440bd15b5 expref: 18 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.367197:0:16420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061844224:0@lo:104: 00000100:00100000:3.0:1788620406.367220:0:16420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620406.367230:0:16420:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6807f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620406.367800:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788620406.367813:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061843968 00000100:00100000:2.0:1788620406.367823:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061843968 00000100:00100000:2.0:1788620406.367863:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844096 00000100:00100000:2.0:1788620406.367866:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844096 00000100:00100000:2.0:1788620406.367875:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844224 00000100:00100000:2.0:1788620406.367877:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844224 00000100:00100000:2.0:1788620406.367890:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788620406.367899:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+5:16420:x1875504061843968:12345-0@lo:104: 00010000:00010000:2.0:1788620406.367911:0:14292:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.367969:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620406.367976:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+5:16420:x1875504061843968:12345-0@lo:104: Request processed in 79us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620406.367983:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788620406.368001:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620406.368007:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+4:16420:x1875504061844096:12345-0@lo:104: 00010000:00010000:2.0:1788620406.368015:0:14292:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368077:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788620406.368083:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+4:16420:x1875504061844096:12345-0@lo:104: Request processed in 77us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620406.368089:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620406.368102:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620406.368108:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67b05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:16420:x1875504061844224:12345-0@lo:104: 00010000:00010000:2.0:1788620406.368115:0:14292:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368149:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788620406.368155:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67b05dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+3:16420:x1875504061844224:12345-0@lo:104: Request processed in 47us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620406.368160:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788620406.368232:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788620406.368239:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368246:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031000 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620406.368274:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368283:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620406.368289:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620406.368294:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620406.368330:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368337:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620406.368360:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368367:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d640031000/0x24857de440bd1736 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd173d expref: -99 pid: 15708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368380:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620406.368382:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368388:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3800 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620406.368391:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368397:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620406.368403:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620406.368408:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620406.368421:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368426:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620406.368441:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368458:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d679fe3800/0x24857de440bd1602 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd1609 expref: -99 pid: 14988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368468:0:14297:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620406.368471:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368477:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc1d33c20) 10000000:00010000:2.0:1788620406.368479:0:14297:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368486:0:14297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620406.368611:0:14297:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620406.368616:0:14297:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620406.368630:0:14297:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368636:0:14297:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788620406.368785:0:16420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061843968:0@lo:104: 00000100:00100000:3.0:1788620406.368795:0:16420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061844096:0@lo:104: 00000100:00100000:3.0:1788620406.368810:0:16420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061844224:0@lo:104: 00010000:00010000:2.0:1788620406.368846:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368854:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.111@tcp lock: ffffa0d67a518200/0x24857de440bd15b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24857de440bd15bc expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.368869:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620406.368877:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620406.368879:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620406.368885:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620406.368890:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620406.368911:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3309:1875504061844352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620406.368950:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620406.368999:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061844480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620406.369023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620406.369043:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620406.369048:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061844608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620406.369217:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844352 00000100:00100000:3.0:1788620406.369223:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844352 00010000:00010000:3.0:1788620406.369246:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1736 expref: 19 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.369312:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844480 00000100:00100000:3.0:1788620406.369315:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844480 00010000:00010000:3.0:1788620406.369326:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1602 expref: 20 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.369338:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620406.369345:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+20:3309:x1875504061844352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620406.369354:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620406.369359:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1736 expref: 20 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.369368:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd1736 expref: 20 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.369381:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d666e2e200/0x24857de440bd173d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd1736 expref: 20 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.369394:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620406.369425:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3309:x1875504061844352:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620406.369432:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620406.369444:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620406.369449:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:3310:x1875504061844480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620406.369464:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620406.369468:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd1602 expref: 18 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.369476:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd1602 expref: 18 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.369485:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d67a519400/0x24857de440bd1609 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd1602 expref: 18 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.369506:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620406.369528:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:3310:x1875504061844480:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620406.369534:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620406.369745:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620406.369776:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061844480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620406.369808:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844608 00000100:00100000:2.0:1788620406.369812:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844608 00010000:00010000:2.0:1788620406.369826:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd15b5 expref: 17 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620406.369844:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620406.369849:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67fb54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:3310:x1875504061844608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620406.369855:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620406.369858:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24857de440bd15b5 expref: 17 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.369866:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24857de440bd15b5 expref: 17 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.369875:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe3000/0x24857de440bd15bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24857de440bd15b5 expref: 17 pid: 14301 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620406.369894:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620406.369921:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67fb54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:3310:x1875504061844608:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620406.369927:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788620406.369976:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3309:1875504061844352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620406.369995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061844608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788620406.378969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620406.379008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620406.379096:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078784 00000100:00100000:1.0:1788620406.379106:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078784 00010000:00010000:1.0:1788620406.379144:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 13 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620406.379186:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045078912 00000100:00100000:1.0:1788620406.379190:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045078912 00010000:00010000:1.0:1788620406.379203:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 14 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620406.379218:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:1.0:1788620406.379228:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0b25c6a-111e-4551-8695-63420def87ec+14:2355:x1875504045078784:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620406.379243:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620406.379273:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 14 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379287:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 14 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379307:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620406.379359:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0b25c6a-111e-4551-8695-63420def87ec+14:2355:x1875504045078784:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 132us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620406.379366:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:1.0:1788620406.379383:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:1.0:1788620406.379389:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0b25c6a-111e-4551-8695-63420def87ec+13:2355:x1875504045078912:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620406.379399:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620406.379418:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 13 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379427:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 13 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379438:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379447:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379463:0:14294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379470:0:14294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379476:0:14294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379483:0:14294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379489:0:14294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641642600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620406.379494:0:14294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379501:0:14294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379509:0:14294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620406.379525:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620406.379545:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0b25c6a-111e-4551-8695-63420def87ec+13:2355:x1875504045078912:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 155us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620406.379551:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00010000:00010000:3.0:1788620406.380000:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d679fe2400/0x24857de440bd189b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2710 expref: 12 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.380015:0:16420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061843712:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620406.380028:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d666e2e800/0x24857de440bd1863 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26ae expref: 11 pid: 14302 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620406.380036:0:16420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16420:1875504061843840:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620406.380081:0:16420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.380090:0:16420:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.380096:0:16420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620406.380110:0:16420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0d641642600/0x24857de440bd18c5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620407.151275:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788620407.402124:0:14305:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620407.402132:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d680a29000 from 10 10000000:01000000:3.0:1788620407.402138:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620407.402186:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd18cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620407.402199:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd18cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620407.402211:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd18cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620407.402236:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061844736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620407.402324:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620407.402373:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad000 going to sleep for 11 seconds 00000100:00100000:2.0:1788620407.402468:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844736 00000100:00100000:2.0:1788620407.402477:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844736 00000100:00100000:2.0:1788620407.402527:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788620407.402537:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+16:14305:x1875504061844736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620407.402549:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620407.402563:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2200/0x24857de440bd18d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd18cc expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.402585:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2200/0x24857de440bd18d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd18cc expref: 17 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.402595:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2200/0x24857de440bd18d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd18cc expref: 17 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.402605:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2200, rc 0) 00000100:00100000:2.0:1788620407.402788:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:14305:x1875504061844736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620407.402794:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788620407.402839:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061844736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620407.402863:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd18cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.402871:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd18cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd18d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620407.402922:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061844864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620407.402948:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620407.402963:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788620407.402975:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844864 00000100:00100000:2.0:1788620407.402978:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844864 00000100:00100000:2.0:1788620407.403000:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788620407.403006:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:14305:x1875504061844864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620407.403233:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:14305:x1875504061844864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620407.403240:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788620407.403287:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061844864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620407.403312:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061844992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620407.403344:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620407.403356:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d664cec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788620407.403367:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061844992 00000100:00100000:2.0:1788620407.403371:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061844992 00000100:00100000:2.0:1788620407.403391:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788620407.403396:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:14305:x1875504061844992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620407.403525:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:14305:x1875504061844992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620407.403540:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788620407.403577:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061844992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788620407.405796:0:16467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788620407.406165:0:14305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788620407.406187:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620407.406198:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd18cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620407.406210:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641643600/0x24857de440bd18cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18d3 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620407.406221:0:14305:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620407.406224:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d65899a000 from 10 10000000:01000000:3.0:1788620407.406239:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620407.406795:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642600/0x24857de440bd18da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620407.406806:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d641642600/0x24857de440bd18da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620407.406816:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d641642600/0x24857de440bd18da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620407.406840:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620407.406905:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620407.406950:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1788620407.407018:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061845120 00000100:00100000:2.0:1788620407.407026:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061845120 00000100:00100000:2.0:1788620407.407077:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788620407.407085:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+17:14305:x1875504061845120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620407.407097:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620407.407108:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd18e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd18da expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.407128:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd18e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd18da expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.407137:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe2a00/0x24857de440bd18e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd18da expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.407146:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2a00, rc 0) 00000100:00100000:2.0:1788620407.407190:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:14305:x1875504061845120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620407.407196:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788620407.407296:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620407.407317:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d641642600/0x24857de440bd18da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620407.407325:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d641642600/0x24857de440bd18da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd18e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620407.407380:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620407.407409:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620407.407432:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64c3796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620407.407491:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061845248 00000100:00100000:2.0:1788620407.407496:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061845248 00000100:00100000:2.0:1788620407.407527:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788620407.407534:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:14305:x1875504061845248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620407.408049:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:14305:x1875504061845248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 513us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620407.408069:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788620407.408135:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620407.408167:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620407.408205:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620407.408229:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64c3796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620407.408286:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061845376 00000100:00100000:2.0:1788620407.408291:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061845376 00000100:00100000:2.0:1788620407.408318:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788620407.408325:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:14305:x1875504061845376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620407.408457:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:14305:x1875504061845376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620407.408463:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788620407.408542:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788620407.411028:0:16468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788620407.411790:0:14305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788620407.411816:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788620407.411828:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d641642600/0x24857de440bd18da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620407.411842:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d641642600/0x24857de440bd18da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620407.411852:0:14305:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788620407.411855:0:14305:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0d679ecc000 from 10 10000000:01000000:1.0:1788620407.411857:0:14305:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788620407.411898:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd18e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620407.411907:0:14305:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd18e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620407.411919:0:14305:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd18e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620407.411947:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d664e0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788620407.412026:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620407.412111:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620407.416370:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061845504 00000100:00100000:2.0:1788620407.416389:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061845504 00000100:00100000:2.0:1788620407.417803:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788620407.417819:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+18:14305:x1875504061845504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620407.417837:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620407.417855:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3800/0x24857de440bd18ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24857de440bd18e8 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.417887:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3800/0x24857de440bd18ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24857de440bd18e8 expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.417897:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe3800/0x24857de440bd18ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24857de440bd18e8 expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620407.417907:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3800, rc 0) 00000100:00100000:2.0:1788620407.417993:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061845504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (5966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620407.418000:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788620407.420891:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d664e0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620407.420928:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd18e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620407.420941:0:14305:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd18e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24857de440bd18ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620407.421023:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620407.421086:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620407.422310:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788620407.425340:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061845632 00000100:00100000:0.0:1788620407.425357:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061845632 00000100:00100000:0.0:1788620407.425428:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788620407.425438:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061845632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620407.425999:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061845632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 561us (4912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620407.426008:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788620407.426071:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620407.426124:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620407.426183:0:14305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620407.426213:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d643645cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620407.426228:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061845760 00000100:00100000:0.0:1788620407.426233:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061845760 00000100:00100000:0.0:1788620407.426284:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788620407.426292:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061845760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620407.426425:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:14305:x1875504061845760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620407.426432:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788620407.426464:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:14305:1875504061845760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788620407.427383:0:16472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788620407.427430:0:14305:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788620407.427448:0:14305:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620407.427458:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd18e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620407.427469:0:14305:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.111@tcp lock: ffffa0d666e2ec00/0x24857de440bd18e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24857de440bd18ef expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620408.170153:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620408.341637:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620408.341713:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045079040 00000100:00100000:3.0:1788620408.341725:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045079040 00000100:00100000:3.0:1788620408.341785:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00100000:3.0:1788620408.341796:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+11:13733:x1875504045079040:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620408.341815:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620408.341840:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d641642a00/0x24857de440bd18f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2741 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620408.341871:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d641642a00/0x24857de440bd18f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2741 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620408.341883:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d641642a00/0x24857de440bd18f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2741 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620408.341893:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641642a00, rc 0) 00000100:00100000:3.0:1788620408.341948:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+12:13733:x1875504045079040:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 153us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620408.341955:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 115 00000100:00100000:2.0:1788620408.348640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620408.348690:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045079168 00000100:00100000:2.0:1788620408.348699:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045079168 00000100:00100000:2.0:1788620408.348749:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 116 00000100:00100000:2.0:1788620408.348759:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+12:13733:x1875504045079168:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620408.349043:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+12:13733:x1875504045079168:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 284us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620408.349052:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 116 00000100:00100000:0.0:1788620408.359809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620408.359850:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045079296 00000100:00100000:0.0:1788620408.359860:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045079296 00000100:00100000:0.0:1788620408.359908:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 117 00000100:00100000:0.0:1788620408.359917:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+12:13733:x1875504045079296:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620408.360126:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+12:13733:x1875504045079296:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 Request processed in 209us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620408.360144:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 117 00000100:00100000:0.0:1788620408.387604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620408.387802:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045079424 00000100:00100000:2.0:1788620408.387813:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045079424 00000100:00100000:2.0:1788620408.387873:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 118 00000100:00100000:2.0:1788620408.387883:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+12:13733:x1875504045079424:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620408.387900:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620408.387916:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0d679fe3a00/0x24857de440bd18fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2748 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620408.387948:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0d679fe3a00/0x24857de440bd18fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2748 expref: 13 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620408.387960:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0d679fe3a00/0x24857de440bd18fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2748 expref: 13 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620408.387969:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe3a00, rc 0) 00000100:00100000:2.0:1788620408.388028:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:13733:x1875504045079424:12345-192.168.201.11@tcp:101:ll_cfg_requeue.0 Request processed in 147us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620408.388036:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 118 00000100:00100000:0.0:1788620408.389448:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620408.389660:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045079552 00000100:00100000:2.0:1788620408.389689:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045079552 00000100:00100000:2.0:1788620408.389742:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:2.0:1788620408.389751:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d650850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+13:13733:x1875504045079552:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620408.390087:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d650850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0b25c6a-111e-4551-8695-63420def87ec+13:13733:x1875504045079552:12345-192.168.201.11@tcp:501:ll_cfg_requeue.0 Request processed in 336us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620408.390095:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 119 00000100:00100000:1.0:1788620408.393531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620408.393733:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045079680 00000100:00100000:2.0:1788620408.393744:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045079680 00000100:00100000:2.0:1788620408.393838:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 120 00000100:00100000:2.0:1788620408.393865:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+13:13733:x1875504045079680:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620408.394117:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0b25c6a-111e-4551-8695-63420def87ec+13:13733:x1875504045079680:12345-192.168.201.11@tcp:503:ll_cfg_requeue.0 Request processed in 260us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620408.394124:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 120 00010000:00010000:2.0:1788620409.192493:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620409.538442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.538669:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045079808 00000100:00100000:2.0:1788620409.538679:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045079808 00000100:00100000:2.0:1788620409.538758:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:2.0:1788620409.538771:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:14389:x1875504045079808:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620409.538791:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.538812:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1904 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b274f expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.538889:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.538905:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.538934:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.538950:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.538957:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.538965:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788620409.539092:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788620409.539743:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd1919 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.539755:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd1919 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.539763:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd1919 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620409.540952:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788620409.540959:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620409.542340:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd1919 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.542363:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.542370:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.542387:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.542393:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.542398:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.542406:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.542421:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.542425:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.542430:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543549:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd190b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543570:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543577:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543583:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543588:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe3e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.543592:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543614:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543627:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0d647f7c100) 00010000:00010000:2.0:1788620409.543629:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.543633:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543638:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1912 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543704:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b274f expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543718:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2400/0x24857de440bd1919 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b274f expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.543726:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0d647f7c400) 00010000:00010000:2.0:1788620409.543728:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620409.543730:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2400, rc 0) 00000100:00100000:2.0:1788620409.543881:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:14389:x1875504045079808:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 5112us (5448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620409.543890:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:3.0:1788620409.573203:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.574052:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045080064 00000100:00100000:1.0:1788620409.574164:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045080064 00000100:00100000:1.0:1788620409.574242:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:1.0:1788620409.574291:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:14389:x1875504045080064:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620409.574319:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620409.574343:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fe00/0x24857de440bd1920 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2756 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.574624:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.574641:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.574661:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.578123:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.578147:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.578161:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584153:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510e00/0x24857de440bd1935 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584180:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510e00/0x24857de440bd1935 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584193:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510e00/0x24857de440bd1935 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620409.584208:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788620409.584588:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584597:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584604:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584611:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620409.584622:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584630:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584644:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0d647f7c400) 00010000:00010000:0.0:1788620409.584659:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620409.584664:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584670:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1927 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584694:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584701:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584706:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.584712:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620409.585393:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.585406:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.585417:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0d64ba6ad00) 00010000:00010000:0.0:1788620409.585420:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620409.585442:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.585450:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd192e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.585964:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2fe00/0x24857de440bd1920 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2756 expref: 10 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.585983:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510e00/0x24857de440bd1935 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2756 expref: 9 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.585992:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d64ba6af00) 00010000:00010000:0.0:1788620409.585995:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620409.586010:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641510e00, rc 0) 00000100:00100000:0.0:1788620409.586101:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14389:x1875504045080064:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 11812us (12906us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788620409.586110:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:0.0:1788620409.589668:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620409.590201:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045080192 00000100:00100000:3.0:1788620409.590213:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045080192 00000100:00100000:3.0:1788620409.590300:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:3.0:1788620409.590311:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14389:x1875504045080192:12345-192.168.201.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788620409.590421:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14389:x1875504045080192:12345-192.168.201.11@tcp:59:lhsmtool_posix.0 Request processed in 112us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620409.590429:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:2.0:1788620409.617645:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.618303:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045080320 00000100:00100000:1.0:1788620409.618315:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045080320 00000100:00100000:1.0:1788620409.618370:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:1.0:1788620409.618383:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14395:x1875504045080320:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:1.0:1788620409.618408:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620409.618427:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd1943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b275d expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.619020:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.619058:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.619140:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.619158:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.619166:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.619173:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.620925:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.620941:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.620956:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.620962:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.620967:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.620975:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.620991:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.620994:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.620999:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621006:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2f800/0x24857de440bd194a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621020:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621026:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621031:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621036:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.621039:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621054:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621121:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0d64c7c2100) 00010000:00010000:2.0:1788620409.621125:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.621128:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621134:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e400/0x24857de440bd1951 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621184:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd1943 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b275d expref: 10 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621195:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.621198:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.621207:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e800/0x24857de440bd1943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b275d expref: 10 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.621217:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2e800, rc 0) 00000100:00100000:2.0:1788620409.621530:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14395:x1875504045080320:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 3147us (3893us total) trans 0 rc 301/301 00000100:00100000:2.0:1788620409.621540:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 18 00000100:00100000:0.0:1788620409.636593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.636990:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045080448 00000100:00100000:1.0:1788620409.637001:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045080448 00000100:00100000:1.0:1788620409.637064:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:1.0:1788620409.637075:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14395:x1875504045080448:12345-192.168.201.11@tcp:700:lfs.0 00000100:00100000:1.0:1788620409.637176:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14395:x1875504045080448:12345-192.168.201.11@tcp:700:lfs.0 Request processed in 102us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620409.637184:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:3.0:1788620409.642583:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.642685:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045080704 00000100:00100000:1.0:1788620409.642697:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045080704 00000100:00100000:1.0:1788620409.643206:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 19 00000100:00100000:1.0:1788620409.643217:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14395:x1875504045080704:12345-192.168.201.11@tcp:36:lfs.0 00010000:00010000:3.0:1788620409.643659:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620409.643695:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1886 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b26d8 expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.644322:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:3.0:1788620409.644330:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620409.648463:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.648493:0:14308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 5 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.648502:0:14308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.648544:0:14308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 5 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.648560:0:14308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 5 pid: 15720 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620409.648576:0:14308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14308:1875504061845888:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620409.648692:0:14308:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620409.651727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.652229:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045080832 00000100:00100000:1.0:1788620409.652239:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045080832 00010000:00010000:1.0:1788620409.652337:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 6 pid: 15720 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620409.652376:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:1.0:1788620409.652386:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:2355:x1875504045080832:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620409.652400:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620409.652407:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 6 pid: 15720 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.652421:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 6 pid: 15720 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.652454:0:14294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:1.0:1788620409.652461:0:14294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.652470:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.652477:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620409.652495:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620409.652548:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:2355:x1875504045080832:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 163us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620409.652557:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00010000:00010000:0.0:1788620409.652756:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd18be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b273a expref: 5 pid: 15720 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620409.652773:0:14308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14308:1875504061845888:192.168.201.11@tcp:104: 00010000:00010000:0.0:1788620409.652792:0:14308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.652801:0:14308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788620409.652930:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788620409.652959:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.652985:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.652995:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.653003:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620409.658465:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788620409.658486:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.658498:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.658506:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.658512:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641643c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620409.658517:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.658525:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.658542:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:0.0:1788620409.658545:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620409.658557:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.658564:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641643c00/0x24857de440bd1958 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620409.658588:0:14308:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000675a08c9 reply state 000000008ff224ad transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620409.658598:0:14308:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620409.658720:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+10:14395:x1875504045080704:12345-192.168.201.11@tcp:36:lfs.0 Request processed in 15500us (16142us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788620409.658729:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 19 00010000:00010000:2.0:1788620409.665287:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.665306:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.665328:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.665334:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.665338:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.665346:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.665363:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0d64ba6ad00) 00010000:00010000:2.0:1788620409.665366:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.665371:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.665377:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd195f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620409.671167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.671234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.671302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.671341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620409.671420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620409.671494:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045081216 00000100:00100000:0.0:1788620409.671505:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045081216 00000100:00100000:0.0:1788620409.671560:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045081472 00000100:00100000:0.0:1788620409.671563:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045081472 00000100:00100000:0.0:1788620409.671574:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045081088 00000100:00100000:0.0:1788620409.671576:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045081088 00000100:00100000:0.0:1788620409.671587:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045081344 00000100:00100000:0.0:1788620409.671589:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045081344 00000100:00100000:0.0:1788620409.671602:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:0.0:1788620409.671611:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045081216:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620409.671689:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045081216:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 79us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620409.671697:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:0.0:1788620409.671714:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620409.671720:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045081472:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620409.671744:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045081472:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620409.671757:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:0.0:1788620409.671768:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620409.671774:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045081088:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620409.671793:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045081088:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 20us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620409.671799:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620409.671806:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:0.0:1788620409.671811:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045081344:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:0.0:1788620409.671837:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:2356:x1875504045081344:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620409.671842:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00080000:1.0:1788620409.672372:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788620409.672377:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620409.672519:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045080960 00000100:00100000:3.0:1788620409.672524:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045080960 00000100:00100000:3.0:1788620409.672559:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 121 00000100:00100000:3.0:1788620409.672564:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:2356:x1875504045080960:12345-192.168.201.11@tcp:400:kworker.0 00000100:00100000:3.0:1788620409.672591:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0b25c6a-111e-4551-8695-63420def87ec+13:2356:x1875504045080960:12345-192.168.201.11@tcp:400:kworker.0 Request processed in 28us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620409.672595:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 121 00000040:00080000:0.0:1788620409.704803:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788620409.732025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620409.732612:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045081600 00000100:00100000:0.0:1788620409.732624:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045081600 00000100:00100000:0.0:1788620409.732749:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:0.0:1788620409.732759:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:14403:x1875504045081600:12345-192.168.201.11@tcp:101:lctl.0 00010000:00010000:0.0:1788620409.732784:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620409.732808:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2764 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.732884:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511600/0x24857de440bd196d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.732899:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511600/0x24857de440bd196d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.732929:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511600/0x24857de440bd196d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620409.732992:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788620409.732996:0:14309:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620409.733043:0:14309:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511600/0x24857de440bd196d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.733070:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2764 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.733092:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511600/0x24857de440bd196d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2764 expref: 10 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.733101:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:0.0:1788620409.733104:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620409.733108:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641511600, rc 0) 00000100:00100000:0.0:1788620409.733192:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+10:14403:x1875504045081600:12345-192.168.201.11@tcp:101:lctl.0 Request processed in 434us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620409.733200:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 20 00000100:00100000:3.0:1788620409.751760:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.752107:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045081728 00000100:00100000:2.0:1788620409.752118:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045081728 00000100:00100000:2.0:1788620409.752178:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:2.0:1788620409.752188:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+5:14404:x1875504045081728:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620409.752211:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.752231:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1974 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b276b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.752334:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd197b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.752362:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd197b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.752372:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd197b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620409.752426:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788620409.752535:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620409.752564:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd197b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.752587:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3e00/0x24857de440bd1974 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b276b expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.752604:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2800/0x24857de440bd197b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b276b expref: 6 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.752612:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.752615:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620409.752619:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d679fe2800, rc 0) 00000100:00100000:2.0:1788620409.752683:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:14404:x1875504045081728:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 496us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620409.752690:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 21 00000100:00100000:1.0:1788620409.756207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.756316:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045081856 00000100:00100000:2.0:1788620409.756326:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045081856 00000100:00100000:2.0:1788620409.756389:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:2.0:1788620409.756401:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+6:14404:x1875504045081856:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620409.756421:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.756465:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2772 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756530:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756542:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756552:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756565:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756571:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756577:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756690:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd1997 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756698:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd1997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756705:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd1997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620409.756744:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788620409.756748:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620409.756773:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd1997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756792:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756798:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756804:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756809:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.756813:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756821:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756833:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.756836:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.756841:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756847:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2c00/0x24857de440bd1989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756870:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756878:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756884:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756895:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d679fe2600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.756898:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756904:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756911:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0d647f7c100) 00010000:00010000:2.0:1788620409.756914:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.756916:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756923:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe2600/0x24857de440bd1990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756953:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d679fe3000/0x24857de440bd1982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2772 expref: 8 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756966:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd1997 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2772 expref: 7 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.756972:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620409.756975:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620409.756977:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67f798e00, rc 0) 00000100:00100000:2.0:1788620409.757040:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+7:14404:x1875504045081856:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 641us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620409.757048:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 22 00000100:00100000:3.0:1788620409.761163:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.761282:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045082112 00000100:00100000:2.0:1788620409.761297:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045082112 00000100:00100000:2.0:1788620409.761357:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:2.0:1788620409.761366:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+7:14404:x1875504045082112:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620409.761385:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.761404:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd199e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2779 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620409.761521:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788620409.761639:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd199e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2779 expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.761668:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.761671:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620409.761677:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd199e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2779 expref: 9 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.761691:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67f799c00, rc 0) 00000100:00100000:2.0:1788620409.761754:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+8:14404:x1875504045082112:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 388us (601us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788620409.761762:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 23 00000100:00100000:3.0:1788620409.766430:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.766536:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045082368 00000100:00100000:2.0:1788620409.766547:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045082368 00000100:00100000:2.0:1788620409.766595:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 24 00000100:00100000:2.0:1788620409.766605:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+8:14404:x1875504045082368:12345-192.168.201.11@tcp:36:lfs.0 00010000:00010000:2.0:1788620409.766665:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620409.766690:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd1997 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2772 expref: 8 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.766738:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620409.766747:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788620409.766770:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.766781:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.766789:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788620409.769228:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b13095c reply state 00000000a5efe2b4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620409.769247:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788620409.769295:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788620409.769401:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1ac873d-065b-4d03-9429-b25a5a081ce1+9:14404:x1875504045082368:12345-192.168.201.11@tcp:36:lfs.0 Request processed in 2793us (2975us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788620409.769411:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 24 00010000:00010000:3.0:1788620409.771300:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.771318:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.771325:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.771331:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f798a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620409.771335:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.771343:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.771359:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7c100) 00010000:00010000:3.0:1788620409.771363:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788620409.771367:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.771372:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798a00/0x24857de440bd19ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620409.772046:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.772096:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045082624 00000100:00100000:2.0:1788620409.772107:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045082624 00000100:00100000:2.0:1788620409.772166:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:2.0:1788620409.772177:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+8:14404:x1875504045082624:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620409.772459:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+9:14404:x1875504045082624:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 283us (417us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788620409.772467:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:0.0:1788620409.774921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.775112:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045082880 00000100:00100000:2.0:1788620409.775136:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045082880 00000100:00100000:2.0:1788620409.775199:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 25 00000100:00100000:2.0:1788620409.775210:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+9:14404:x1875504045082880:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620409.775236:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.775293:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd19b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2780 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775369:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775383:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775394:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775409:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775417:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775423:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620409.775553:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788620409.775641:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775662:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775679:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775685:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f799e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.775689:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775696:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775709:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.775724:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.775729:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775735:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd19ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775749:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775760:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775766:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775771:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f798c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620409.775774:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775789:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775798:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620409.775801:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620409.775804:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.775809:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd19c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.776177:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd19b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2780 expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.776190:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:2.0:1788620409.776192:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620409.776197:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd19b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2780 expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.776206:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67f799c00, rc 0) 00000100:00100000:2.0:1788620409.776444:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1ac873d-065b-4d03-9429-b25a5a081ce1+10:14404:x1875504045082880:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1234us (1531us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788620409.776453:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 25 00000100:00100000:0.0:1788620409.780081:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.780219:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045083008 00000100:00100000:2.0:1788620409.780230:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045083008 00000100:00100000:2.0:1788620409.780325:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 26 00000100:00100000:2.0:1788620409.780335:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+10:14404:x1875504045083008:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620409.780381:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.780403:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd19cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2787 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.780506:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.780520:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.780533:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620409.780581:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788620409.780585:0:14309:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620409.780609:0:14309:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.780639:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd19cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.780671:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.780681:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620409.780684:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620409.780689:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67f799800, rc 0) 00000100:00100000:2.0:1788620409.780745:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+11:14404:x1875504045083008:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 411us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620409.780753:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 26 00000100:00100000:3.0:1788620409.790725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620409.790828:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045083136 00000100:00100000:0.0:1788620409.790840:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045083136 00000100:00100000:0.0:1788620409.790900:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:0.0:1788620409.790911:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1ac873d-065b-4d03-9429-b25a5a081ce1+11:14404:x1875504045083136:12345-192.168.201.11@tcp:37:lfs.0 00000100:00100000:2.0:1788620409.802054:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1ac873d-065b-4d03-9429-b25a5a081ce1+11:14404:x1875504045083136:12345-192.168.201.11@tcp:37:lfs.0 Request processed in 11127us (11322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620409.802072:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:3.0:1788620409.809845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.810204:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045083392 00000100:00100000:2.0:1788620409.810227:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045083392 00000100:00100000:2.0:1788620409.810311:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:2.0:1788620409.810323:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d648532450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+11:14404:x1875504045083392:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620409.810591:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d648532450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1ac873d-065b-4d03-9429-b25a5a081ce1+12:14404:x1875504045083392:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 270us (1400us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788620409.810600:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:3.0:1788620409.866795:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620409.866945:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045083520 00000100:00100000:0.0:1788620409.866971:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045083520 00000100:00100000:0.0:1788620409.867106:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:0.0:1788620409.867118:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+10:14410:x1875504045083520:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:0.0:1788620409.867140:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620409.867163:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510000/0x24857de440bd19dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b278e expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867247:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867313:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867326:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867344:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867352:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867358:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867485:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd19f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867494:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd19f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867501:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd19f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620409.867539:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788620409.867544:0:14308:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620409.867590:0:14308:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd19f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867617:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867625:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867632:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867638:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620409.867650:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867659:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867672:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:0.0:1788620409.867675:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620409.867680:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867687:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd19e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867708:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867724:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867730:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867735:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620409.867738:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867744:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867751:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0d64ba6a700) 00010000:00010000:0.0:1788620409.867754:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620409.867756:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867762:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd19eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867796:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510000/0x24857de440bd19dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b278e expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867810:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511c00/0x24857de440bd19f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b278e expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.867818:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:0.0:1788620409.867820:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788620409.867828:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641511c00, rc 0) 00000100:00100000:0.0:1788620409.867941:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+11:14410:x1875504045083520:12345-192.168.201.11@tcp:101:bash.0 Request processed in 825us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620409.867949:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 27 00000100:00100000:1.0:1788620409.878729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.879982:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045083776 00000100:00100000:2.0:1788620409.879998:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045083776 00000100:00100000:2.0:1788620409.880076:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 28 00000100:00100000:2.0:1788620409.880086:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+11:14410:x1875504045083776:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:2.0:1788620409.880106:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.880127:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd19f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b2795 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.880319:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.880335:0:14309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.880345:0:14309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.880380:0:14309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.880408:0:14309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 11 pid: 14309 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620409.880423:0:14309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14309:1875504061846016:192.168.201.11@tcp:104: 00000100:00100000:2.0:1788620409.880519:0:14309:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119600 going to sleep for 11 seconds 00000100:00100000:2.0:1788620409.886144:0:14309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14309:1875504061846016:192.168.201.11@tcp:104: 00010000:00010000:2.0:1788620409.886175:0:14309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620409.892163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.892284:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045083904 00000100:00100000:2.0:1788620409.892295:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045083904 00010000:00010000:2.0:1788620409.892349:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 12 pid: 14309 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620409.892388:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:2.0:1788620409.892397:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1ac873d-065b-4d03-9429-b25a5a081ce1+12:2356:x1875504045083904:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620409.892411:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620409.892418:0:14293:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 12 pid: 14309 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.892431:0:14293:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 12 pid: 14309 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.892452:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd19d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2787 expref: 12 pid: 14309 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.892490:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:2.0:1788620409.892494:0:14293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.892505:0:14293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.892523:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.892558:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620409.892619:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1ac873d-065b-4d03-9429-b25a5a081ce1+11:2356:x1875504045083904:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 222us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620409.892627:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00010000:00010000:0.0:1788620409.892662:0:14309:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.892673:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.892698:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.892709:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.892718:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893510:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893521:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893528:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620409.893538:0:14309:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788620409.893564:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893571:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893584:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893590:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f799c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620409.893595:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893745:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893756:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:0.0:1788620409.893759:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620409.893763:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893769:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799c00/0x24857de440bd1a00 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620409.893781:0:14309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d8a5b51 reply state 00000000e1db4c57 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620409.893789:0:14309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788620409.893822:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798e00/0x24857de440bd19f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 14 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893837:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 13 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620409.893844:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:0.0:1788620409.893852:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788620409.893855:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641510800, rc 0) 00000100:00100000:0.0:1788620409.893921:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:14410:x1875504045083776:12345-192.168.201.11@tcp:101:bash.0 Request processed in 13836us (15201us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788620409.893930:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 28 00010000:00010000:3.0:1788620409.902536:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.902576:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.902583:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.902590:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620409.902595:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.902602:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.902621:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0d64ba6a700) 00010000:00010000:3.0:1788620409.902625:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620409.902630:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620409.902636:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1a07 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620409.914280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.914637:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045084032 00000100:00100000:2.0:1788620409.914660:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045084032 00000100:00100000:2.0:1788620409.914730:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 29 00000100:00100000:2.0:1788620409.914741:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+13:14410:x1875504045084032:12345-192.168.201.11@tcp:101:bash.0 00010000:00010000:2.0:1788620409.914771:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620409.914797:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b279c expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.914864:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.914877:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.914907:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620409.914950:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788620409.914954:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620409.914975:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.914987:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.915011:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 15 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.915029:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620409.915037:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:2.0:1788620409.915040:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620409.915044:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67f798c00, rc 0) 00000100:00100000:2.0:1788620409.915110:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:14410:x1875504045084032:12345-192.168.201.11@tcp:101:bash.0 Request processed in 371us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620409.915117:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 29 00000100:00100000:1.0:1788620409.920070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620409.920151:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045084288 00000100:00100000:2.0:1788620409.920161:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045084288 00000100:00100000:2.0:1788620409.920229:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620409.920240:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:14410:x1875504045084288:12345-192.168.201.11@tcp:35:bash.0 00000100:00100000:2.0:1788620409.920589:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+15:14410:x1875504045084288:12345-192.168.201.11@tcp:35:bash.0 Request processed in 350us (529us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788620409.920848:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:1.0:1788620410.028115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.028377:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045084544 00000100:00100000:3.0:1788620410.028388:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045084544 00000100:00100000:3.0:1788620410.028456:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 30 00000100:00100000:3.0:1788620410.028467:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+15:14420:x1875504045084544:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:3.0:1788620410.028491:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.028512:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27a3 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620410.028671:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788620410.028810:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27a3 expref: 17 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.028825:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0d64ba6ac00) 00010000:00010000:3.0:1788620410.028828:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620410.028832:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27a3 expref: 17 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.028846:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031800, rc 0) 00000100:00100000:3.0:1788620410.028904:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+16:14420:x1875504045084544:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 438us (798us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788620410.028911:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 30 00000100:00100000:3.0:1788620410.031636:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.031759:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045084800 00000100:00100000:2.0:1788620410.031769:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045084800 00000100:00100000:2.0:1788620410.031845:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:2.0:1788620410.031858:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+16:14420:x1875504045084800:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:2.0:1788620410.032126:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+17:14420:x1875504045084800:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 272us (498us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788620410.032135:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:1.0:1788620410.094589:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.094737:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045085056 00000100:00100000:2.0:1788620410.094748:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045085056 00000100:00100000:2.0:1788620410.094816:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:2.0:1788620410.094827:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+17:14423:x1875504045085056:12345-192.168.201.11@tcp:101:lfs.0 00010000:00010000:2.0:1788620410.094851:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620410.094873:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a38 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27aa expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.094989:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd1a3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.095004:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd1a3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.095019:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd1a3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620410.095031:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788620410.095170:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a38 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27aa expref: 20 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.095218:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd1a3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27aa expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.095226:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:2.0:1788620410.095229:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620410.095233:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67f799e00, rc 0) 00000100:00100000:2.0:1788620410.095973:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+19:14423:x1875504045085056:12345-192.168.201.11@tcp:101:lfs.0 Request processed in 1143us (1389us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788620410.095982:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 31 00000100:00100000:1.0:1788620410.104922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620410.104965:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.105060:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045085312 00000100:00100000:0.0:1788620410.105070:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045085312 00000100:00100000:0.0:1788620410.105137:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:0.0:1788620410.105148:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+19:2354:x1875504045085312:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620410.105164:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620410.105198:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799e00/0x24857de440bd1a3f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27aa expref: 19 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.105216:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:0.0:1788620410.105221:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620410.105309:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:2354:x1875504045085312:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 161us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620410.105317:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:3.0:1788620410.105539:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045085184 00000100:00100000:3.0:1788620410.105543:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045085184 00000100:00100000:3.0:1788620410.105571:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:3.0:1788620410.105576:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d664e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:14423:x1875504045085184:12345-192.168.201.11@tcp:54:lfs.0 00010000:00010000:3.0:1788620410.105621:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105631:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105653:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105701:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105720:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105726:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105733:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620410.105738:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105746:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105756:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.105759:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620410.105763:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.105769:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620410.105816:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d664e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:14423:x1875504045085184:12345-192.168.201.11@tcp:54:lfs.0 Request processed in 239us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.105824:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 32 00000100:00100000:1.0:1788620410.108754:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.108918:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045085568 00000100:00100000:0.0:1788620410.108929:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045085568 00000100:00100000:0.0:1788620410.108990:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:0.0:1788620410.109001:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:14423:x1875504045085568:12345-192.168.201.11@tcp:35:lfs.0 00000100:00100000:0.0:1788620410.109226:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+19:14423:x1875504045085568:12345-192.168.201.11@tcp:35:lfs.0 Request processed in 227us (481us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788620410.109234:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00010000:00010000:3.0:1788620410.216691:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620410.339202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.339278:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045085824 00000100:00100000:3.0:1788620410.339290:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045085824 00000100:00100000:3.0:1788620410.339356:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:3.0:1788620410.339367:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+19:14454:x1875504045085824:12345-192.168.201.11@tcp:101:cat.0 00010000:00010000:3.0:1788620410.339392:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.339410:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27b1 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.339579:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.339590:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.339599:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620410.339606:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788620410.339753:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27b1 expref: 22 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.339768:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27b1 expref: 21 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.339775:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.339777:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620410.339779:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031000, rc 0) 00000100:00100000:3.0:1788620410.340044:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+21:14454:x1875504045085824:12345-192.168.201.11@tcp:101:cat.0 Request processed in 679us (852us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788620410.340049:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 33 00000100:00100000:1.0:1788620410.342955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.343070:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045086080 00000100:00100000:2.0:1788620410.343079:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045086080 00000100:00100000:2.0:1788620410.343139:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:2.0:1788620410.343149:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+21:14454:x1875504045086080:12345-192.168.201.11@tcp:35:cat.0 00000100:00100000:2.0:1788620410.343626:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+22:14454:x1875504045086080:12345-192.168.201.11@tcp:35:cat.0 Request processed in 477us (679us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788620410.343644:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 8 00000100:00100000:3.0:1788620410.343692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.343806:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045086208 00000100:00100000:2.0:1788620410.343811:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045086208 00000100:00100000:2.0:1788620410.343851:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:2.0:1788620410.343859:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+22:2356:x1875504045086208:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620410.343869:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620410.343891:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27b1 expref: 22 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.343907:0:14294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:2.0:1788620410.343918:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620410.343983:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+21:2356:x1875504045086208:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620410.343990:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:1.0:1788620410.397089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.397191:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045086464 00000100:00100000:0.0:1788620410.397201:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045086464 00000100:00100000:3.0:1788620410.397285:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:3.0:1788620410.397298:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+21:14460:x1875504045086464:12345-192.168.201.11@tcp:101:dd.0 00010000:00010000:3.0:1788620410.397324:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.397344:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a69 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27b8 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.397437:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.397450:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 22 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.397459:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 22 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.397467:0:15720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.397500:0:15720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 22 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.397509:0:15720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 22 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620410.397519:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15720:1875504061846144:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620410.397605:0:15720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 22 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.397632:0:15720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 22 pid: 14309 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620410.397653:0:15720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15720:1875504061846272:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620410.397677:0:15720:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620410.400908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620410.400997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.401234:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15720:1875504061846144:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620410.401278:0:15720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15720:1875504061846272:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620410.401303:0:15720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620410.401563:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045086592 00000100:00100000:2.0:1788620410.401571:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045086592 00010000:00010000:2.0:1788620410.401610:0:14293:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 23 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620410.401707:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045086720 00000100:00100000:3.0:1788620410.401711:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045086720 00010000:00010000:3.0:1788620410.401728:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 24 pid: 14309 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620410.401795:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:3.0:1788620410.401813:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67fb56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:2355:x1875504045086592:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620410.401829:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620410.401836:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 24 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.401848:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 24 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.401879:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798c00/0x24857de440bd1a23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b279c expref: 24 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.401909:0:14294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.401915:0:14294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.401923:0:14294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.401929:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620410.401983:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67fb56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+23:2355:x1875504045086592:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 180us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.401991:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:3.0:1788620410.402034:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:3.0:1788620410.402041:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+22:2355:x1875504045086720:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620410.402048:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620410.402053:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 22 pid: 14309 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.402061:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 22 pid: 14309 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.402072:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1a0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b2795 expref: 22 pid: 14309 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.402088:0:14294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.402092:0:14294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.402108:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.402114:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.402133:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620410.402150:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+21:2355:x1875504045086720:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 109us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.402156:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00010000:00010000:3.0:1788620410.402175:0:15720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.402183:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620410.402200:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788620410.403144:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a69 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27b8 expref: 22 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.403164:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031c00/0x24857de440bd1a70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27b8 expref: 21 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.403173:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.403175:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788620410.403179:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031c00, rc 0) 00000100:00100000:3.0:1788620410.403229:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+21:14460:x1875504045086464:12345-192.168.201.11@tcp:101:dd.0 Request processed in 5935us (6150us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788620410.403267:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 34 00000100:00100000:1.0:1788620410.405987:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.406103:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045086976 00000100:00100000:2.0:1788620410.406114:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045086976 00000100:00100000:2.0:1788620410.406165:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 35 00000100:00100000:2.0:1788620410.406172:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+21:14460:x1875504045086976:12345-192.168.201.11@tcp:36:dd.0 00010000:00010000:2.0:1788620410.406505:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.406518:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.406526:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620410.406569:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788620410.406588:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000419f4340 reply state 00000000e7fd1d85 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620410.406594:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620410.406722:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14460:x1875504045086976:12345-192.168.201.11@tcp:36:dd.0 Request processed in 549us (746us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788620410.406729:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 35 00000020:00080000:2.0:1788620410.406747:0:14310:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788620410.409453:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.409504:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045087104 00000100:00100000:0.0:1788620410.409514:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045087104 00000100:00100000:0.0:1788620410.409573:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 36 00000100:00100000:0.0:1788620410.409584:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14460:x1875504045087104:12345-192.168.201.11@tcp:101:dd.0 00010000:00010000:0.0:1788620410.409608:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620410.409628:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd1a85 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27bf expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.409701:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd1a85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27bf expref: 25 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.409715:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd1a85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27bf expref: 25 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.409735:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:0.0:1788620410.409739:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620410.409743:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d641510400, rc 0) 00010000:00010000:3.0:1788620410.409788:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.409797:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620410.409801:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+25:14460:x1875504045087104:12345-192.168.201.11@tcp:101:dd.0 Request processed in 219us (357us total) trans 0 rc 0/0 00010000:00010000:3.0:1788620410.409805:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620410.409807:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 36 00010000:00010000:3.0:1788620410.413716:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f799800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620410.413726:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.413736:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.413756:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.413760:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620410.413765:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.413772:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799800/0x24857de440bd1a7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620410.420107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.420461:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045087360 00000100:00100000:2.0:1788620410.420470:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045087360 00000100:00100000:2.0:1788620410.420539:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:2.0:1788620410.420550:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14460:x1875504045087360:12345-192.168.201.11@tcp:103:dd.0 00010000:00010000:2.0:1788620410.420566:0:14293:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620410.420591:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510400/0x24857de440bd1a85 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27bf expref: 24 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.420618:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:2.0:1788620410.420624:0:14293:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620410.420691:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+23:14460:x1875504045087360:12345-192.168.201.11@tcp:103:dd.0 Request processed in 143us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620410.420699:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:1.0:1788620410.423064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.423141:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045087488 00000100:00100000:2.0:1788620410.423150:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045087488 00000100:00100000:2.0:1788620410.423208:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:2.0:1788620410.423219:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+23:14460:x1875504045087488:12345-192.168.201.11@tcp:58:dd.0 00010000:00010000:2.0:1788620410.423346:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.423362:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.423374:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620410.424288:0:14310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620410.424844:0:14310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788620410.424930:0:14310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788620410.425046:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+23:14460:x1875504045087488:12345-192.168.201.11@tcp:58:dd.0 Request processed in 1824us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620410.425056:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 37 00000100:00100000:1.0:1788620410.427397:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.427485:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045087616 00000100:00100000:3.0:1788620410.427495:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045087616 00000100:00100000:3.0:1788620410.427553:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:3.0:1788620410.427563:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+23:14460:x1875504045087616:12345-192.168.201.11@tcp:101:dd.0 00010000:00010000:3.0:1788620410.427582:0:15720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.427613:0:15720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27c6 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.427703:0:15720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.427714:0:15720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27c6 expref: 24 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.427733:0:15720:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.427746:0:15720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27c6 expref: 24 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.427759:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.427762:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620410.427766:0:15720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27c6 expref: 24 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.427774:0:15720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d640031800, rc 0) 00000100:00100000:3.0:1788620410.427838:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14460:x1875504045087616:12345-192.168.201.11@tcp:101:dd.0 Request processed in 276us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.427846:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 38 00000100:00100000:2.0:1788620410.728532:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061846400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620410.728603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788620410.728764:0:14339:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788620410.728769:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620410.728816:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788620410.728823:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788620410.728915:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d643724380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14339:1875504061846528:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788620410.728978:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d64c379000 going to sleep for 11 seconds 00000100:00100000:1.0:1788620410.729393:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061846400 00000100:00100000:1.0:1788620410.729400:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061846400 00000100:00100000:1.0:1788620410.729463:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788620410.729473:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061846400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620410.729502:0:14994:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620410.729673:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061846400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 201us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620410.729688:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620410.730579:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061846400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788620410.733922:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788620410.734989:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.735287:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045087744 00000100:00100000:2.0:1788620410.735297:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045087744 00000100:00100000:2.0:1788620410.735360:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:2.0:1788620410.735370:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+25:14461:x1875504045087744:12345-192.168.201.11@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788620410.735459:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+25:14461:x1875504045087744:12345-192.168.201.11@tcp:900:lhsmtool_posix.0 Request processed in 90us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620410.735466:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:0.0:1788620410.735963:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d643724380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14339:1875504061846528:192.168.201.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788620410.737799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.737879:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045087872 00000100:00100000:3.0:1788620410.737889:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045087872 00000100:00100000:3.0:1788620410.737938:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:3.0:1788620410.737947:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14461:x1875504045087872:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788620410.737975:0:14308:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788620410.738088:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14461:x1875504045087872:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 142us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.738097:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 39 00000100:00100000:1.0:1788620410.746971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.747134:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045088000 00000100:00100000:3.0:1788620410.747144:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045088000 00000100:00100000:3.0:1788620410.747205:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 40 00000100:00100000:3.0:1788620410.747215:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14461:x1875504045088000:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788620410.747356:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747373:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747384:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747445:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747453:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747460:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747486:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747493:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747500:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620410.747563:0:15720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788620410.747567:0:15720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620410.747582:0:15720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747593:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747600:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747607:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747613:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d640031000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620410.747618:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747626:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747650:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d64ba6af00) 00010000:00010000:3.0:1788620410.747653:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620410.747658:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747664:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031000/0x24857de440bd1a9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747681:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747696:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747701:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747705:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620410.747708:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747714:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747720:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa0d65309e400) 00010000:00010000:3.0:1788620410.747723:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620410.747725:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747730:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1aa1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747744:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747750:0:15720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747756:0:15720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747760:0:15720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620410.747769:0:15720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747775:0:15720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747783:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.747786:0:15720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620410.747788:0:15720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.747794:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aa8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620410.748127:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14461:x1875504045088000:12345-192.168.201.11@tcp:34:lhsmtool_posix.0 Request processed in 911us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.748136:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 40 00000100:00100000:1.0:1788620410.758291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.758551:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045088256 00000100:00100000:3.0:1788620410.758562:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045088256 00000100:00100000:3.0:1788620410.758625:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 41 00000100:00100000:3.0:1788620410.758648:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:14461:x1875504045088256:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620410.758670:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.758691:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aaf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27cd expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.758789:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.758817:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.758847:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620410.758860:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788620410.758959:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.758967:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.758973:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.758980:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620410.758984:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.758993:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.759005:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:3.0:1788620410.759008:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788620410.759014:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.759021:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1ab6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.759060:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aaf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27cd expref: 26 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.759082:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0d64ba6af00) 00010000:00010000:3.0:1788620410.759085:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620410.759090:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1aaf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27cd expref: 26 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.759101:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518200, rc 0) 00000100:00100000:3.0:1788620410.759553:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+25:14461:x1875504045088256:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 906us (1309us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788620410.759562:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 41 00000100:00100000:2.0:1788620410.767524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.768578:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045088384 00000100:00100000:3.0:1788620410.768592:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045088384 00000100:00100000:3.0:1788620410.768723:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 42 00000100:00100000:3.0:1788620410.768735:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+25:14461:x1875504045088384:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788620410.768771:0:15720:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788620410.768890:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+25:14461:x1875504045088384:12345-192.168.201.11@tcp:53:lhsmtool_posix.0 Request processed in 157us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.768898:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 42 00000100:00100000:0.0:1788620410.772236:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.772573:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045088640 00000100:00100000:3.0:1788620410.772582:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045088640 00000100:00100000:3.0:1788620410.772692:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:3.0:1788620410.772703:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+25:14461:x1875504045088640:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620410.772725:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.772745:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1ac4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27d4 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788620410.774109:0:14308:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1788620410.774118:0:14308:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788620410.774169:0:14308:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788620410.774861:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1acb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.774879:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.774891:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1acb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.774959:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1ac4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27d4 expref: 28 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.774978:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1acb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27d4 expref: 27 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.774987:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d65309e400) 00010000:00010000:3.0:1788620410.774990:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620410.774994:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a519400, rc 0) 00000100:00100000:3.0:1788620410.775108:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+27:14461:x1875504045088640:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 2406us (2993us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788620410.775118:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 43 00000100:00100000:1.0:1788620410.780355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.780739:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045088896 00000100:00100000:0.0:1788620410.780750:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045088896 00000100:00100000:0.0:1788620410.780819:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:0.0:1788620410.780829:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+27:14461:x1875504045088896:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620410.780894:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620410.780921:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519400/0x24857de440bd1acb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27d4 expref: 27 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.780941:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d65309e400) 00010000:00010000:0.0:1788620410.780950:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620410.780973:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.780986:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.780995:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781010:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781016:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781023:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781113:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781121:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781128:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781135:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620410.781138:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781146:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781154:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0d647f7cc00) 00010000:00010000:0.0:1788620410.781156:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620410.781160:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781166:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1ad9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781183:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781189:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781195:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781206:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620410.781209:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781214:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781222:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xac3f754c (ffffa0d64ba6a300) 00010000:00010000:0.0:1788620410.781225:0:14309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620410.781227:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.781233:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1ae0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xac3f754c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620410.781381:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+26:14461:x1875504045088896:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 552us (1035us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620410.781389:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 44 00000100:00100000:1.0:1788620410.789503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620410.789680:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045089024 00000100:00100000:2.0:1788620410.789690:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045089024 00000100:00100000:2.0:1788620410.789748:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:2.0:1788620410.789758:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+26:14461:x1875504045089024:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620410.789777:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620410.789799:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798000/0x24857de440bd1ae7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27db expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.789844:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798800/0x24857de440bd1aee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.789874:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798800/0x24857de440bd1aee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.789886:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798800/0x24857de440bd1aee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.789974:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798000/0x24857de440bd1ae7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27db expref: 28 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.789991:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f798800/0x24857de440bd1aee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27db expref: 27 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.790000:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620410.790002:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788620410.790006:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67f798800, rc 0) 00000100:00100000:2.0:1788620410.790068:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+27:14461:x1875504045089024:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 311us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620410.790075:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 45 00000100:00100000:2.0:1788620410.800776:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.800944:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045089280 00000100:00100000:0.0:1788620410.800954:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045089280 00000100:00100000:0.0:1788620410.801053:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 46 00000100:00100000:0.0:1788620410.801064:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+27:14461:x1875504045089280:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788620410.801165:0:14309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.801182:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.801194:0:14309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620410.801669:0:14309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788620410.801680:0:14309:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460840429795ns, next at 461840427299ns, rc = 0 00000004:00010000:0.0:1788620410.801760:0:14309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cf7e3f2 reply state 00000000de8337f6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620410.801770:0:14309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620410.802787:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+29:14461:x1875504045089280:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 1718us (2014us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788620410.802798:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 46 00010000:00010000:3.0:1788620410.808540:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.808557:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.808572:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.808577:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788620410.808582:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.808590:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.808606:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620410.808609:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788620410.808613:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.808619:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641511200/0x24857de440bd1af5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14309 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620410.809530:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.809739:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045089408 00000100:00100000:3.0:1788620410.809750:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045089408 00000100:00100000:3.0:1788620410.809817:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:3.0:1788620410.809828:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+28:14461:x1875504045089408:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620410.809851:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.809869:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27e2 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.809924:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 29 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.809949:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 29 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.809968:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620410.809971:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788620410.809974:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518200, rc 0) 00000100:00100000:3.0:1788620410.810032:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+29:14461:x1875504045089408:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 206us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.810040:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 47 00000100:00100000:1.0:1788620410.812763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.812859:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045089536 00000100:00100000:0.0:1788620410.812868:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045089536 00000100:00100000:0.0:1788620410.812926:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:0.0:1788620410.812937:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+5:2356:x1875504045089536:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788620410.813385:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:2356:x1875504045089536:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 448us (629us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788620410.813393:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 12 00000100:00100000:2.0:1788620410.818151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620410.818676:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045089792 00000100:00100000:1.0:1788620410.818687:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045089792 00000100:00100000:1.0:1788620410.818752:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:1.0:1788620410.818762:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+29:14461:x1875504045089792:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788620410.819131:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+30:14461:x1875504045089792:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 370us (993us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788620410.819139:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 9 00000100:00100000:2.0:1788620410.821972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.822047:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045090048 00000100:00100000:3.0:1788620410.822057:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045090048 00000100:00100000:3.0:1788620410.822147:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:3.0:1788620410.822157:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+30:14461:x1875504045090048:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788620410.822293:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+30:14461:x1875504045090048:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 137us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.822301:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 48 00000100:00100000:0.0:1788620410.824820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.824895:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045090176 00000100:00100000:3.0:1788620410.824905:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045090176 00000100:00100000:3.0:1788620410.824957:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:3.0:1788620410.824966:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+30:14461:x1875504045090176:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620410.824986:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620410.825006:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27e9 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.825076:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b0a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.825105:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.825117:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620410.825154:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620410.825171:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.825198:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e9 expref: 32 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.825216:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e9 expref: 31 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.825225:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620410.825228:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788620410.825232:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d67a518400, rc 0) 00000100:00100000:3.0:1788620410.825329:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d643726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+31:14461:x1875504045090176:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 364us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620410.825336:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 49 00000100:00100000:2.0:1788620410.832974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620410.834297:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045090304 00000100:00100000:1.0:1788620410.834313:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045090304 00000100:00100000:1.0:1788620410.834383:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:1.0:1788620410.834393:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+6:2353:x1875504045090304:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620410.834690:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620410.834712:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6083ab6bfc9b27f0 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620410.834741:0:14991:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2e7a, blocks: 0x1 00010000:00010000:1.0:1788620410.834760:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788620410.834764:0:14991:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620410.834787:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 7 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.834807:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 7 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.834821:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0d666e2e400, rc 0) 00000100:00100000:1.0:1788620410.835031:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:2353:x1875504045090304:12345-192.168.201.11@tcp:101:lhsmtool_posix.0 Request processed in 637us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620410.835040:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:2.0:1788620410.839652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.839737:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045090560 00000100:00100000:0.0:1788620410.839749:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045090560 00000100:00100000:0.0:1788620410.839833:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:0.0:1788620410.839844:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+31:14461:x1875504045090560:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788620410.839982:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+31:14461:x1875504045090560:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 139us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620410.839990:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 50 00000100:00100000:2.0:1788620410.843713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.843844:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045090688 00000100:00100000:3.0:1788620410.843854:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045090688 00000100:00100000:3.0:1788620410.843918:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 51 00000100:00100000:3.0:1788620410.843928:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+31:14461:x1875504045090688:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788620410.907164:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+31:14461:x1875504045090688:12345-192.168.201.11@tcp:44:lhsmtool_posix.0 Request processed in 63225us (63450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620410.907192:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 51 00000001:00080000:2.0:1788620410.907242:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1788620410.907270:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788620410.907295:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1788620410.907315:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788620410.907454:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6515e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061846656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788620410.907521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620410.907585:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061846656 00000100:00100000:2.0:1788620410.907592:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061846656 00000100:00100000:2.0:1788620410.907640:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620410.907649:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061846656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788620410.907782:0:14989:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788620410.907786:0:14989:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788620410.907788:0:14989:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788620410.907790:0:14989:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788620410 -> 1788620410 00002000:00010000:2.0:1788620410.907792:0:14989:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788620410.908004:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875504061846656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 355us (492us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788620410.908011:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788620410.908050:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0d6515e0a80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788620410.908056:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6515e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061846656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788620410.910771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620410.910907:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045090816 00000100:00100000:1.0:1788620410.910919:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045090816 00000100:00100000:1.0:1788620410.910976:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:1.0:1788620410.910986:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:2355:x1875504045090816:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788620410.911110:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:2355:x1875504045090816:12345-192.168.201.11@tcp:16:lhsmtool_posix.0 Request processed in 125us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620410.911117:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 15 00000100:00100000:1.0:1788620410.917306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.917403:0:15720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045091072 00000100:00100000:3.0:1788620410.917506:0:15720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045091072 00000100:00100000:3.0:1788620410.917608:0:15720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:3.0:1788620410.917621:0:15720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:14461:x1875504045091072:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788620410.917685:0:15720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620410.917711:0:15720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e9 expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.917730:0:15720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:3.0:1788620410.917735:0:15720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620410.917765:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.917779:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.917789:0:15720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620410.920495:0:15720:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d808d55 reply state 0000000074c28e3c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620410.920527:0:15720:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620410.920657:0:15720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+15:14461:x1875504045091072:12345-192.168.201.11@tcp:36:lhsmtool_posix.0 Request processed in 3034us (3411us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788620410.920667:0:15720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 52 00000100:00100000:2.0:1788620410.927171:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.927278:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045091200 00000100:00100000:3.0:1788620410.927288:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045091200 00000100:00100000:3.0:1788620410.927343:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 16 00000100:00100000:3.0:1788620410.927353:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+7:2356:x1875504045091200:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788620410.927550:0:14992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788620410.927555:0:14992:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788620409 00002000:00010000:3.0:1788620410.927557:0:14992:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788620409 00002000:00010000:3.0:1788620410.927559:0:14992:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788620410 -> 1788620409 00002000:00010000:3.0:1788620410.927561:0:14992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788620410.927617:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+8:2356:x1875504045091200:12345-192.168.201.11@tcp:2:lhsmtool_posix.0 Request processed in 266us (456us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788620410.927645:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 16 00010000:00010000:0.0:1788620410.928514:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.928527:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.928535:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.928541:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a519e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788620410.928546:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.928552:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.928568:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:0.0:1788620410.928572:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620410.928576:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.928582:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a519e00/0x24857de440bd1b18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620410.931620:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.931730:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045091328 00000100:00100000:0.0:1788620410.931743:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045091328 00000100:00100000:0.0:1788620410.931882:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:0.0:1788620410.931893:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6515e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+8:2356:x1875504045091328:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788620410.931937:0:14989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.931954:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620410.931957:0:14989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620410.931963:0:14989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.931976:0:14989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.932002:0:14989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.932009:0:14989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.932016:0:14989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.932022:0:14989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510000 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620410.932026:0:14989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.932035:0:14989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.932054:0:14989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.932061:0:14989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279e3583/0x24857de440bd1b1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620410.932139:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6515e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+8:2356:x1875504045091328:12345-192.168.201.11@tcp:1:lhsmtool_posix.0 Request processed in 248us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620410.932146:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 17 00000100:00100000:2.0:1788620410.934507:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.936100:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045091584 00000100:00100000:3.0:1788620410.936116:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045091584 00000100:00100000:3.0:1788620410.936184:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 53 00000100:00100000:3.0:1788620410.936204:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:14461:x1875504045091584:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788620410.936360:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.936376:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.936387:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.936611:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.936622:0:14308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 15 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.936641:0:14308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.936672:0:14308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 15 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620410.936685:0:14308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 15 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620410.936710:0:14308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14308:1875504061846784:192.168.201.11@tcp:104: 00000100:00100000:3.0:1788620410.936791:0:14308:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d6583adb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620410.940237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620410.940370:0:14308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a7dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14308:1875504061846784:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620410.940398:0:14308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620410.940493:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045091712 00000100:00100000:1.0:1788620410.940501:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045091712 00010000:00010000:1.0:1788620410.940538:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 16 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620410.940576:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 13 00000100:00100000:1.0:1788620410.940585:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+16:2355:x1875504045091712:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620410.940600:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620410.940613:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 16 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.940633:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 16 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.940656:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518200/0x24857de440bd1afc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27e2 expref: 16 pid: 14310 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.940673:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:1.0:1788620410.940679:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.940688:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.940696:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.940718:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620410.940764:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680393100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+15:2355:x1875504045091712:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 180us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620410.940772:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 13 00010000:00010000:1.0:1788620410.940793:0:14308:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.941103:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788620410.941307:0:14308:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788620410.941458:0:14308:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788620410.941514:0:14308:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788620410.941590:0:14308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14308:1875504061846912:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788620410.941684:0:14308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620410.941711:0:14308:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620410.941819:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061846912 00000100:00100000:2.0:1788620410.941824:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061846912 00000100:00100000:2.0:1788620410.941873:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620410.941881:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d680b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14308:x1875504061846912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788620410.941959:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14308:x1875504061846912:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620410.941967:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620410.942090:0:14308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14308:1875504061846912:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788620410.942706:0:14308:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788620410.942764:0:14308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680393b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14308:1875504061847040:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788620410.942796:0:14308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620410.942820:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061847040 00000100:00100000:2.0:1788620410.942824:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061847040 00000100:00100000:2.0:1788620410.942845:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620410.942851:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14308:x1875504061847040:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788620410.942983:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14308:x1875504061847040:12345-0@lo:1000:mdt00_000.0 Request processed in 131us (185us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788620410.942990:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620410.943130:0:14308:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620410.943151:0:14308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680393b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14308:1875504061847040:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788620410.943176:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943185:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943193:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943205:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620410.943209:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943217:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943231:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620410.943234:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620410.943239:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943245:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518c00/0x24857de440bd1b2d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943289:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943297:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943301:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943305:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f799000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788620410.943308:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943312:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943331:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:2.0:1788620410.943333:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620410.943339:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27c6 expref: 18 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943348:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27c6 expref: 18 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943355:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27c6 expref: 18 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.943398:0:14308:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0d640031800/0x24857de440bd1a93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27c6 expref: 18 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620410.943408:0:14308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d6804c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14308:1875504061847168:192.168.201.11@tcp:105: 00000100:00100000:2.0:1788620410.943516:0:14308:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d67a119300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620410.946998:0:14308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d6804c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14308:1875504061847168:192.168.201.11@tcp:105: 00010000:00010000:1.0:1788620410.947026:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947036:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67f799000/0x24857de440bd1a8c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947063:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947076:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947087:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947096:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947103:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947109:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947115:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620410.947118:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947142:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947153:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:1.0:1788620410.947156:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620410.947159:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947165:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d666e2e200/0x24857de440bd1b34 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947176:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947181:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947187:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947191:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67a518400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788620410.947194:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947199:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947206:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0d64ba6ab00) 00010000:00010000:1.0:1788620410.947208:0:14308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788620410.947211:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620410.947224:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d67a518400/0x24857de440bd1b26 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620410.947457:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d680391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:14461:x1875504045091584:12345-192.168.201.11@tcp:57:lhsmtool_posix.0 Request processed in 11256us (12957us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788620410.947466:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 53 00000020:00080000:1.0:1788620410.947472:0:14308:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788620410.947694:0:14339:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788620410.947698:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620410.947720:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788620410.947728:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788620410.949158:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.949215:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045091840 00000100:00100000:0.0:1788620410.949224:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045091840 00000100:00100000:0.0:1788620410.949299:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:0.0:1788620410.949307:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d648531450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:14460:x1875504045091840:12345-192.168.201.11@tcp:49:dd.0 00000100:00100000:0.0:1788620410.949421:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d648531450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:14460:x1875504045091840:12345-192.168.201.11@tcp:49:dd.0 Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620410.949428:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 10 00000100:00100000:2.0:1788620410.952729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:0.0:1788620410.952791:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092096 00000100:00100000:0.0:1788620410.952809:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092096 00000100:00100000:0.0:1788620410.952863:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 11 00000100:00100000:0.0:1788620410.952873:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+18:14461:x1875504045092096:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788620410.953530:0:14311:0:(mdd_object.c:4179:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788620410.953651:0:14311:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788620410.953694:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.953711:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.953722:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.953730:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.953735:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.953740:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620410.953758:0:14311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788620410.953837:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+20:14461:x1875504045092096:12345-192.168.201.11@tcp:35:lhsmtool_posix.0 Request processed in 964us (1115us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788620410.953845:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 11 00000020:00080000:0.0:1788620410.953850:0:14311:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788620410.954178:0:15972:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620410.954185:0:15972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.954193:0:15972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641510800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620410.954197:0:15972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.954205:0:15972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.954226:0:15972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0d647f7c900) 00010000:00010000:2.0:1788620410.954228:0:15972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788620410.954232:0:15972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.954237:0:15972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0d641510800/0x24857de440bd1b3b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620410.954280:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620410.954282:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620410.954284:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620411.098684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620411.098727:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620411.098829:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092352 00000100:00100000:1.0:1788620411.098839:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092352 00000100:00100000:1.0:1788620411.098919:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092224 00000100:00100000:1.0:1788620411.098922:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092224 00000100:00100000:1.0:1788620411.098941:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:1.0:1788620411.098950:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:2353:x1875504045092352:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:1.0:1788620411.098982:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.099004:0:14995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 9 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.099013:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788620411.099017:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.099022:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.099056:0:14995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 9 pid: 14991 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.099087:0:14995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 9 pid: 14991 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620411.099102:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d680b76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:14995:1875504061847296:192.168.201.11@tcp:104: 00000100:00100000:1.0:1788620411.099182:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0d675d4c900 going to sleep for 11 seconds 00000100:00080000:0.0:1788620411.099284:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620411.103416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620411.103459:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620411.103492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620411.103642:0:14996:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788620411.103654:0:14996:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788620411.103774:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788620411.103790:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092480 00000100:00100000:2.0:1788620411.103799:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092480 00000100:00100000:2.0:1788620411.103844:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788620411.103848:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092608 00000100:00100000:2.0:1788620411.103850:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092608 00000100:00100000:2.0:1788620411.103863:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788620411.103867:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092736 00000100:00100000:2.0:1788620411.103869:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092736 00000100:00100000:1.0:1788620411.104645:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:1.0:1788620411.104657:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+12:2353:x1875504045092224:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:1.0:1788620411.104694:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.104712:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.104716:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.104720:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.104729:0:16535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.108288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620411.108393:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788620411.108403:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788620411.109088:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092864 00000100:00100000:2.0:1788620411.109099:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092864 00000100:00100000:1.0:1788620411.109775:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:1.0:1788620411.109788:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+13:2354:x1875504045092480:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:1.0:1788620411.109838:0:16536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.109863:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.109868:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.109873:0:16536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.110002:0:16536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.113213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:1.0:1788620411.113454:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788620411.113464:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1788620411.113824:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045092992 00000100:00100000:2.0:1788620411.113832:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045092992 00000100:00100000:1.0:1788620411.114580:0:16537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:1.0:1788620411.114593:0:16537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:2354:x1875504045092608:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:1.0:1788620411.114643:0:16537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.114662:0:16537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.114667:0:16537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.114672:0:16537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.114682:0:16537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620411.117343:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d680b76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:14995:1875504061847296:192.168.201.11@tcp:104: 00010000:00010000:3.0:1788620411.117376:0:14995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.118207:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:2.0:1788620411.118296:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.11@tcp (source: 12345-192.168.201.11@tcp) 00000100:00100000:3.0:1788620411.118364:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045093248 00000100:00100000:3.0:1788620411.118372:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045093248 00010000:00010000:3.0:1788620411.118417:0:14294:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 15 pid: 14991 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620411.118459:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 14 00000100:00100000:3.0:1788620411.118468:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+15:2356:x1875504045093248:12345-192.168.201.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788620411.118481:0:14294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620411.118503:0:14294:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 15 pid: 14991 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118535:0:14294:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 15 pid: 14991 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118559:0:14294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2628956/0x24857de440bd1b11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.11@tcp remote: 0x6083ab6bfc9b27f0 expref: 15 pid: 14991 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118575:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118579:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118584:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118593:0:14294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118601:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118604:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118607:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118614:0:14294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118619:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118633:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118637:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118656:0:14294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118663:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118666:0:14294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620411.118670:0:14294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118678:0:14294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118719:0:14294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620411.118766:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:2356:x1875504045093248:12345-192.168.201.11@tcp:103:ldlm_bl.0 Request processed in 299us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620411.118774:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 14 00010000:00010000:3.0:1788620411.118809:0:14995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.118818:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.119819:0:16536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.119833:0:16536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.120796:0:16535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620411.120810:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620411.122038:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:1.0:1788620411.122051:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00010000:00010000:2.0:1788620411.122197:0:16537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.122215:0:16537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620411.123930:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504045093120 00000100:00100000:1.0:1788620411.123948:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504045093120 00000100:00100000:0.0:1788620411.124821:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 4 00000100:00100000:0.0:1788620411.124834:0:16538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+17:2354:x1875504045092736:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:0.0:1788620411.124883:0:16538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.124899:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620411.124908:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620411.124915:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.124928:0:16538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788620411.203975:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1788620411.203991:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788620411.203999:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1788620411.204049:0:14995:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:2.0:1788620411.204052:0:14995:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788620409 -> 1788620410 00002000:00010000:2.0:1788620411.204054:0:14995:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788620409 -> 1788620410 00002000:00010000:2.0:1788620411.204056:0:14995:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788620411.204068:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204078:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204085:0:14995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204089:0:14995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620411.204093:0:14995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204099:0:14995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204114:0:14995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204134:0:14995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7cf42b/0x24857de440bd1b42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.204285:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+24:2353:x1875504045092352:12345-192.168.201.11@tcp:4:dd.0 Request processed in 105295us (105569us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788620411.204295:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 0 00000100:00100000:2.0:1788620411.204324:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 5 00000100:00100000:2.0:1788620411.204336:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+23:2353:x1875504045092864:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:2.0:1788620411.204367:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204380:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620411.204384:0:14995:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620411.204391:0:14995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.204411:0:14995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788620411.234349:0:16535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1788620411.234360:0:16535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 10247 00000001:00080000:0.0:1788620411.234405:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:0.0:1788620411.234425:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:2.0:1788620411.234463:0:16535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.234477:0:16535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.234500:0:16535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234500:0:16536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234510:0:16536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234517:0:16536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.234518:0:16535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2fe00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620411.234522:0:16536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620411.234523:0:16535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234526:0:16536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.234532:0:16535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234534:0:16536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.234556:0:16535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234556:0:16536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.234565:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6793868/0x24857de440bd1b49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234565:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fdd2ac9/0x24857de440bd1b50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.234702:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+16:2353:x1875504045092224:12345-192.168.201.11@tcp:4:dd.0 Request processed in 130042us (135968us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788620411.234703:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+16:2354:x1875504045092480:12345-192.168.201.11@tcp:4:dd.0 Request processed in 124919us (131307us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788620411.234713:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 1 00000100:00100000:1.0:1788620411.234718:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 2 00000100:00100000:1.0:1788620411.234743:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 6 00000100:00100000:1.0:1788620411.234755:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+14:2354:x1875504045092992:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:1.0:1788620411.234801:0:16536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234813:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.234817:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620411.234823:0:16536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.234834:0:16536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.234998:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.11@tcp, seq: 7 00000100:00100000:2.0:1788620411.235009:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+15:2354:x1875504045093120:12345-192.168.201.11@tcp:4:dd.0 00010000:00010000:2.0:1788620411.235027:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.235035:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620411.235044:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620411.235048:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.235058:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.235242:0:16538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.235277:0:16538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.235284:0:16538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.235290:0:16538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d641511200 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620411.235293:0:16538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.235300:0:16538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.235321:0:16538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.235329:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023b14dcf/0x24857de440bd1b5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.235339:0:16537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.235346:0:16537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.235353:0:16537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.235359:0:16537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2e800 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620411.235363:0:16537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620411.235363:0:16538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+15:2354:x1875504045092736:12345-192.168.201.11@tcp:4:dd.0 Request processed in 110533us (131870us total) trans 8589934601 rc 0/0 00010000:00010000:2.0:1788620411.235371:0:16537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620411.235371:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 4 00010000:00010000:2.0:1788620411.235381:0:16537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.235388:0:16537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db8c1c5d/0x24857de440bd1b57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.235693:0:16537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+13:2354:x1875504045092608:12345-192.168.201.11@tcp:4:dd.0 Request processed in 121103us (132233us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788620411.235700:0:16537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 3 00000100:00100000:2.0:1788620411.240832:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061847424:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.240922:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620411.240965:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061847936:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.240989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620411.241012:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788620411.241018:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061847552:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241039:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620411.241054:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061848064:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241074:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620411.241103:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061847680:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241124:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620411.241143:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620411.241148:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061847808:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620411.241199:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061847424 00000100:00100000:2.0:1788620411.241206:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061847424 00000100:00100000:2.0:1788620411.241305:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788620411.241314:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d6767ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3310:x1875504061847424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241363:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6767ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6b86f1d4-eff3-445d-9e1f-653b1e2161fe+19:3310:x1875504061847424:12345-0@lo:400:kworker.0 Request processed in 51us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620411.241389:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788620411.241422:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061847936 00000100:00100000:2.0:1788620411.241426:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061847936 00000100:00100000:2.0:1788620411.241458:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061848064 00000100:00100000:2.0:1788620411.241462:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061848064 00000100:00100000:2.0:1788620411.241475:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061847808 00000100:00100000:2.0:1788620411.241478:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061847808 00000100:00100000:2.0:1788620411.241491:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788620411.241498:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061847936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241530:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875504061847936:12345-0@lo:400:kworker.0 Request processed in 32us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620411.241537:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788620411.241549:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788620411.241555:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061848064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241581:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875504061848064:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620411.241587:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788620411.241599:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788620411.241605:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061847808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241649:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875504061847808:12345-0@lo:400:kworker.0 Request processed in 45us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620411.241655:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788620411.241674:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061847552 00000100:00100000:2.0:1788620411.241677:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061847552 00000100:00100000:2.0:1788620411.241697:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061847680 00000100:00100000:2.0:1788620411.241700:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061847680 00000100:00100000:2.0:1788620411.241715:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620411.241727:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061847552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241759:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875504061847552:12345-0@lo:400:kworker.0 Request processed in 33us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620411.241764:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620411.241777:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620411.241783:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061847680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241808:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875504061847680:12345-0@lo:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620411.241813:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788620411.241839:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620411.241843:0:14304:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620411.241875:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875504061847808:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241886:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875504061847680:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241918:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788620411.241924:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0d6515e0a80, transno 8589934595 00000004:00080000:2.0:1788620411.241934:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788620411.241950:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875504061847552:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241962:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875504061848064:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241970:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6b86f1d4-eff3-445d-9e1f-653b1e2161fe:3310:1875504061847424:0@lo:400:kworker.0 00000100:00100000:2.0:1788620411.241978:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875504061847936:0@lo:400:kworker.0 00010000:00010000:2.0:1788620411.243084:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620411.243338:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788620411.243354:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0d67a06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061848192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620411.243410:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620411.243821:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875504061848192 00000100:00100000:0.0:1788620411.243829:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875504061848192 00000100:00100000:2.0:1788620411.244044:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620411.244056:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0d67a068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061848192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620411.244094:0:14994:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788620411.244147:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d67a068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875504061848192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620411.244154:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620411.244200:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0d67a06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875504061848192:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1788620411.286521:0:14995:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1788620411.286531:0:14995:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1788620411.286546:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.286558:0:14995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.286568:0:14995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.286575:0:14995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f799c00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:1.0:1788620411.286580:0:14995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.286589:0:14995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788620411.286592:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:1.0:1788620411.286629:0:14995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620411.286638:0:14995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd645ee2/0x24857de440bd1b65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620411.286719:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+13:2353:x1875504045092864:12345-192.168.201.11@tcp:4:dd.0 Request processed in 82381us (178464us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788620411.286729:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 5 00002000:00010000:2.0:1788620411.329829:0:16535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1788620411.329851:0:16535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.329878:0:16535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.329889:0:16535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.329896:0:16535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d67f798a00 already unused, calling callback (ffffffffc1716250) 00010000:00010000:2.0:1788620411.329901:0:16535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.329910:0:16535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.329929:0:16535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620411.329953:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f98bb99/0x24857de440bd1b73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620411.330056:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+11:2354:x1875504045093120:12345-192.168.201.11@tcp:4:dd.0 Request processed in 95044us (211847us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788620411.330066:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 7 00010000:00010000:0.0:1788620411.331080:0:16536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.331095:0:16536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.331103:0:16536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.331180:0:16536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0d666e2f600 already unused, calling callback (ffffffffc1716250) 00010000:00010000:0.0:1788620411.331185:0:16536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.331195:0:16536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.331226:0:16536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620411.331233:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529fe4c1/0x24857de440bd1b6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620411.331337:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0d6804c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:57a5b6d9-e7c6-4cad-8bc6-bbb67be83b0a+9:2354:x1875504045092992:12345-192.168.201.11@tcp:4:dd.0 Request processed in 96582us (218130us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788620411.331345:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.11@tcp, seq: 6 00000001:00080000:0.0:1788620411.331374:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:0.0:1788620411.331389:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000040:00080000:1.0:1788620412.010412:0:14339:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788620412.010421:0:14339:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788620412.010450:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788620412.010457:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788620412.267366:0:14297:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788620412.941375:0:16575:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788620413.288555:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620414.313391:0:14296:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29020 lines, 29020 kept, 0 dropped, 0 bad.